Model seems broken?
#1
by McG-221 - opened
Does the model run on your side? I only get gibberish... 🤔
Yeah, this is an issue in mlx_vlm with mxfp8, mxpf4 and nvfp4 quants and all new Qwen3.5 MoE models. https://github.com/Blaizzy/mlx-vlm/issues/778
The model has been updated and fixed. Please delete your local copy and download it again.
TheCluster changed discussion status to closed
Can confirm that it works just fine now! ✌️