JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-1.5B-FP8-Dynamic
Text Generation • 2B • Updated • 4
FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM
Accurate FP8 quantized deepseek R1 distilled models, ready for use with SGLang and vLLM!
-
-
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-7B-FP8-Dynamic
Text Generation • 8B • Updated • 6 • 1 -
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-8B-FP8-Dynamic
Text Generation • 8B • Updated • 4 • 1 -
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic
Text Generation • 15B • Updated • 4 • 1 -
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic
Text Generation • 33B • Updated • 5.56k • 2 -
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-70B-FP8-Dynamic
Text Generation • 71B • Updated • 11