Ollama template
#6
by yqchen-sci - opened
Could you please provide the Ollama template for this model? The previous non-REAP version consumed too much VRAM, and I would like to use this model on my local Ollama instance.
I've had good luck so far with this one. Note that my settings are geared towards tool calling.
FROM hf.co/unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF:Q6_K_XL
TEMPLATE {{ .Prompt }}
RENDERER glm-4.7
PARSER glm-4.7
PARAMETER num_ctx 65535
PARAMETER num_predict 8192
PARAMETER temperature 0.7
PARAMETER top_p 1.0
PARAMETER min_p 0.01
I've had good luck so far with this one. Note that my settings are geared towards tool calling.
Wow, thanks! I'll have a try.