Hugging Face's logo

Beinsezii
/
Mistral-Small-3.2-24B-Instruct-2506-Q6F-Q8A-GGUF

GGUF
imatrix
conversational
Model card Files
xet
 Community
  • Q6F: Q6_K ffns
  • Q8A: Q8_0 attn, other layers

Fits long context on a 24GiB GPU

Downloads last month
28
GGUF
Model size
24B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

View all variants
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Beinsezii/Mistral-Small-3.2-24B-Instruct-2506-Q6F-Q8A-GGUF

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.2-24B-Instruct-2506
Quantized
(54)
this model

Collection including Beinsezii/Mistral-Small-3.2-24B-Instruct-2506-Q6F-Q8A-GGUF