Qwen/Qwen2.5-1.5B-Instruct-AWQ
Text Generation • 2B • Updated • 777k • 6
AWQ quants
AWQ quants of various leading models for benchmarks and testing
-
-
Qwen/Qwen2.5-3B-Instruct-AWQ
Text Generation • 3B • Updated • 141k • 16 -
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation • Updated • 858k • 40 -
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation • 15B • Updated • 1.88M • 33 -
Qwen/Qwen2-VL-2B-Instruct-AWQ
Image-Text-to-Text • 2B • Updated • 96.1k • 24 -
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text • 8B • Updated • 1.66M • 49 -
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ
Text Generation • 15B • Updated • 613k • 16 -
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation • Updated • 227k • 89 -
TheBloke/Mixtral_11Bx2_MoE_19B-AWQ
Text Generation • 19B • Updated • 10 • 5 -
TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ
Text Generation • 1B • Updated • 3.74k • 6 -
internlm/internlm2_5-7b-chat-4bit
Text Generation • Updated • 67 • 5 -
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation • 9B • Updated • 1.21k • 8 -
casperhansen/deepseek-r1-distill-qwen-7b-awq
8B • Updated • 54.9k • 8 -
casperhansen/deepseek-r1-distill-llama-8b-awq
8B • Updated • 43.4k • 3 -
casperhansen/deepseek-r1-distill-qwen-14b-awq
15B • Updated • 113k • 14