this is really mxfp4 model tested on R9700 and got 33t/s. Best model for 256GB vram

Mex Context Size: 131k

Downloads last month
262
Safetensors
Model size
215B params
Tensor type
BF16
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for djdeniro/Qwen3.5-397B-A17B-MXFP4

Quantized
(5)
this model