YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantized version of https://huggingface.co/NeverSleep/Lumimaid-v0.2-70B 3.8 BPW weights with a 6 BPW head
The measurement file is included in case you want to run the quant yourself.
- Downloads last month
- 3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support