GGUF llama.cpp quantized version of:
- Original model: Mistral-Small-3.2-24B-Instruct-2506
- Model creator: Mistral
- License
Recommended Prompt Format (mistral-v7-tekken)
<s>[SYSTEM_PROMPT]<system prompt>[/SYSTEM_PROMPT][INST]<user message>[/INST]<assistant response></s>[INST]<user message>[/INST]
- Downloads last month
- 6
Hardware compatibility
Log In to add your hardware
4-bit
5-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support