Static quantization of Cydonia-v4.1-MS3.2-Magnum-Diamond-24B
| File | Notes |
|---|---|
| Q6_K with select tensors quantized to Q8_0 7.10 bpw Quantized from BF16 Very close in fidelity to full precision |
|
| Multimodal Projector BF16 Native precision |
- Downloads last month
- 30
Hardware compatibility
Log In to add your hardware
6-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support