Error 400 and no Tool support

#3
by simbolik - opened

I am getting an error 400 when pulling the image using ollama.
The workaround I did was to get it through wget and make a modelfile with a context window.

After trying it through opencode, it did not support tool calling. had to make a more additions to my modelfile to get it to work.
I feel like not pulling it through ollama directly, is giving me more issues.

Can you please advise.

If you use ollama show model-nameand it does not show "tools" in capabilities, then the chat template is missing tool support. Try something like this, tested with another GGUF model from HF:

# point to downloaded GGUF
FROM ./Qwen3.5-9B.Q4_K_M.gguf

# use Ollama engine
TEMPLATE {{ .Prompt }}
RENDERER qwen3.5
PARSER qwen3.5

# suggested parameters for the official model, you may tweak it
PARAMETER top_p 0.95
PARAMETER presence_penalty 1.5
PARAMETER temperature 1
PARAMETER top_k 20

LICENSE "                                Apache License
                           Version 2.0, January 2004
                        http://www.apache.org/licenses/
"

me too
ollama run hf.co/Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF:Q4_K_M
pulling manifest
pulling d0ecd80b0e45: 100% β–•β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– 5.6 GB
Error: 400:

Sign up or log in to comment