Template issues: tool calling?

#2
by ComputeWisely - opened

Thank you for sharing this!

Does your finetune have the same issue with tool calling as the original Unsloth versions ( https://www.reddit.com/r/unsloth/comments/1rgemmh/qwen35_unsloth_ggufs_update/)?

oh probablly because I didnt ressolve that as unsloth did ... but test and let me know.

I tried using the Q8 from https://huggingface.co/mradermacher/Qwen3.5-122B-A10B-heretic-GGUF (serving it locally using Llama.cpp to Cline and Roo Code in VS Codium).

I'm getting errors in Cline when the mmproj is loaded (vision works fine from the Llama.cpp web interface though). However, so far, it is running okay blind (with vision disabled) within Cline.

Roo Code seems to be fine with your model though (with vision enabled too) - so I recommend using it instead of Cline for this model.

Thank you again for sharing your work! Much appreciated.

Sign up or log in to comment