GGUFs for Hercules-Qwen 1.5 14B - https://huggingface.co/M4-ai/Hercules-Qwen1.5-14B

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Downloads last month
33
GGUF
Model size
14B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train MarsupialAI/Hercules-Qwen1.5-14B_iMatrix_GGUF