noctrex

/

Qwen3.5-35B-A3B-MXFP4_MOE-GGUF

like 15

When trying to use this model using ollama using the "Use this model" functionality, the hub provides the following tags:
noctrex/Qwen3.5-35B-A3B-MXFP4_MOE-GGUF:MXFP4_MOE_BF for the BF16 model
hf.co/noctrex/Qwen3.5-35B-A3B-MXFP4_MOE-GGUF:MXFP4_MOE_F for the FP16 model

When I try to use this model in ollama using the following automatically generated command:
ollama run hf.co/noctrex/Qwen3.5-35B-A3B-MXFP4_MOE-GGUF:MXFP4_MOE_BF

I get this error in ollama: The specified tag is not available in the repository. Please use another tag or "latest"

I found out that using ollama run hf.co/noctrex/Qwen3.5-35B-A3B-MXFP4_MOE-GGUF:MXFP4_MOE_BF16 fixes that issue.
I'm not sure if this is a huggingface issue or an issue related to the model card.

For those who are experiencing similar issues this is because the filenames of the models: Qwen3.5-35B-A3B-MXFP4_MOE_BF16.gguf don't match the tags: Qwen3.5-35B-A3B-MXFP4_MOE-GGUF:MXFP4_MOE_BF.