why is this mlx model almost unusable with looping in lm studio
#1
by uptonking - opened
- i am downloading and running this model in lm studio on my macbook
- other glm-4.7-flash mlx model sometimes gets into loops
- this mxfp4 mlx almost gets into loops everytime, unusable
- my config
- temperature 0.7
- repeat penality 1.0
- top-k 30
- top-p 0.95
- i tried other format of this model, https://huggingface.co/unsloth/GLM-4.7-Flash-GGUF Q4_K_L rarely gets into loops