Constantly getting stuck
Hello,
This model is the first Gemma MOE I saw passing the 15 Tool Tests, so I was excited to use in my project. The project is going thru dozens of entries and fact checking them against live web searches via Tavily. I've tested a many models and this is also the only one which gets stuck, simply takes many minutes without responding, as if it is in an internal loop. using --reasoning off solves the issue, but then it loses some of its wit. i.e. it scores less on my internal tests than other models, such as CelesteImperia one. And doesn't pass on anymore on stevibe's test.
Hello,
This model is the first Gemma MOE I saw passing the 15 Tool Tests, so I was excited to use in my project. The project is going thru dozens of entries and fact checking them against live web searches via Tavily. I've tested a many models and this is also the only one which gets stuck, simply takes many minutes without responding, as if it is in an internal loop. using
--reasoning offsolves the issue, but then it loses some of its wit. i.e. it scores less on my internal tests than other models, such as CelesteImperia one. And doesn't pass on anymore on stevibe's test.
There is a new version of this model https://huggingface.co/TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-v2-GGUF it should be better
Sorry, I commented on the wrong page, this is what I am using: TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-v2-GGUF/gemma-4-26B-A4B-it-Claude-Opus-Distill.q8_0.gguf \