模型效果很不理想……
#4
by zeerd - opened
尝试了一下Qwen3.5-35B-A3B的模型（FP8版本），问题很多：
- 基于"responses"接口调用时，工具（function call）返回的所有参数都是string类型的，导致调用失败。
- 基于"chat"接口调用时，对于工具返回结果识别率差。我的脚本有confirm工具，并且返回了成功。结果模型在没有调用任何其他工具进行任何改动的前提下还是在不停的重复单调地调用confirm工具。
- 基于"chat"接口调用时，工具调用时参数个数不对。工具声明所有参数必须提供，模型固执地认为有些参数是可选的，不予提供。导致调用失败。
已经切换回Qwen3-Next-80B-A3B模型。
Found this discussion under root model card. It seems the user has deleted its account. But using the fixed chat template do solve the tool call issue. Under my 200K context chat, all the tool call was now normal.
Found this discussion under root model card. It seems the user has deleted its account. But using the fixed chat template do solve the tool call issue. Under my 200K context chat, all the tool call was now normal.
That poster deleted their account. Could you please share the template?