Error loading "unsloth/GLM-4.5-Air-GGUF" via LM Studio

#10
by DaniDubi - opened

Hey,

I downloaded Q4_K_S and Q4_K_M versions of this card GLM-4.5-Air via LM Studio (v0.3.22), and got the following error when tried to load them:
"error loading model architecture: unknown model architecture: 'glm4moe'"

MLX versions are working fine!

I have Mac Studio M4 Max, and the runtime version of Metal llama.cpp is v1.44.0.

Looking forward for a way to try Unsloth quants!
Thanks

Unsloth AI org

I just tried it on my own Mac. It works. Are you sure you updated your app? :)

DaniDubi changed discussion status to closed

Sign up or log in to comment