RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16 Text Generation • 7B • Updated Mar 13, 2025 • 373 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16 Text Generation • 0.6B • Updated Feb 27, 2025 • 71 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8 Text Generation • 2B • Updated Feb 27, 2025 • 6.15k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 135 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 4.87k • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 344 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16 Text Generation • 3B • Updated Feb 27, 2025 • 334 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8 Text Generation • 15B • Updated Feb 27, 2025 • 3.37k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • 6B • Updated Feb 27, 2025 • 488 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8 Text Generation • Updated Feb 27, 2025 • 639 • 13
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic Text Generation • 33B • Updated Feb 27, 2025 • 992 • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 Text Generation • 11B • Updated Feb 27, 2025 • 655 • 6
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • 71B • Updated Feb 27, 2025 • 155 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic Text Generation • 71B • Updated Feb 27, 2025 • 3.38k • 10