iMatrix GGUF quants of https://huggingface.co/TheDrummer/Rocinante-12B-v1
iMat generated using Kalomaze's groups_merged.txt
- Downloads last month
- 22
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support