alishafique/Phi-4-mini-reasoning-quantized.autoround-w4a16-llmcompressor 4B • Updated 5 days ago • 32
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.autoround-w4a16-llmcompressor 2B • Updated 5 days ago • 40
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.autoround-w4a16-llmcompressor 2B • Updated 5 days ago • 26
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8kv8fp8-autoround-llmcompressor 8B • Updated 9 days ago • 27
alishafique/Phi-4-mini-reasoning-quantized.w8a8kv8fp8-autoround-llmcompressor 4B • Updated 9 days ago • 22
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8kv8fp8-llmcompressor 2B • Updated 9 days ago • 24
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8kv8fp8-autoround-llmcompressor 2B • Updated 9 days ago • 29
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8kv8fp8-llmcompressor 8B • Updated 11 days ago • 36
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8fp8-llmcompressor 8B • Updated 11 days ago • 20
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.gptq-w8a16-llmcompressor 3B • Updated 11 days ago • 20
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a4int4-llmcompressor 2B • Updated 14 days ago • 20
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a8int8-llmcompressor 2B • Updated 14 days ago • 19
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.gptq-w8a16-llmcompressor 2B • Updated 14 days ago • 14