brandonbeiler/InternVL3_5-30B-A3B-FP8-Dynamic
Image-Text-to-Text • 31B • Updated • 42 • 2
Edit Models filters
Apps
Inference Providers
Active filters: llm-compressor
brandonbeiler/InternVL3_5-GPT-OSS-20B-A4B-Preview-FP8-Dynamic
Image-Text-to-Text • 21B • Updated • 27 • 2
brandonbeiler/InternVL3_5-14B-FP8-Dynamic
Image-Text-to-Text • 15B • Updated • 30
brandonbeiler/InternVL3_5-8B-FP8-Dynamic
Image-Text-to-Text • 9B • Updated • 134 • 1
brandonbeiler/InternVL3_5-4B-FP8-Dynamic
Image-Text-to-Text • 5B • Updated • 6
brandonbeiler/InternVL3_5-2B-FP8-Dynamic
Image-Text-to-Text • 2B • Updated • 15 • 1
brandonbeiler/InternVL3_5-1B-FP8-Dynamic
Image-Text-to-Text • 1B • Updated • 35
benyamini/DSR1-8B-llmc-awq-w4
Text Generation • 2B • Updated • 6
edge-inference/DSR1-8B-llmc-awq-w4
Text Generation • 2B • Updated • 5
edge-inference/DSR1-14B-llmc-awq-w4
Text Generation • 3B • Updated • 3
edge-inference/DSR1-32B-llmc-awq-w4
Text Generation • 6B • Updated • 4
edge-inference/DSR1-1.5B-llmc-awq-w4
Text Generation • 0.6B • Updated • 4 • 1
kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-16klen-NVFP4
1B • Updated • 1
kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-2klen-NVFP4
1B • Updated • 2
kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-16klen-NVFP4
3B • Updated • 2
kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-2klen-NVFP4
3B • Updated • 2
itroot/Qwen3-4B-Instruct-2507-W8A8
Text Generation • 4B • Updated • 8
RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic
Text Generation • 8B • Updated • 370 • 3
RedHatAI/Apertus-70B-Instruct-2509-FP8-dynamic
Text Generation • 71B • Updated • 105 • 1
RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16
Text Generation • 11B • Updated • 65 • 1
kaitchup/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 9
itroot/Qwen3-4B-Thinking-2507-W8A8
Text Generation • 4B • Updated • 3
RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-dynamic
Text Generation • 236B • Updated • 92 • 4
RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-block
Text Generation • 236B • Updated • 39 • 3
RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic
Text Generation • 9B • Updated • 3.63k • 3
RedHatAI/Llama-3.1-8B-Instruct-FP8-block
Text Generation • 8B • Updated • 55
nm-testing/Llama-3.1-70B-Instruct-FP8-block
Text Generation • Updated
RedHatAI/Qwen3-14B-FP8-block
Text Generation • 15B • Updated • 19
nm-testing/Qwen3-30B-A3B-FP8-block
Text Generation • 3B • Updated • 7
RedHatAI/Qwen3-32B-FP8-block
Text Generation • 33B • Updated • 19