Ollama does not support this yet
#3
by vinnitu - opened
ollama run hf.co/unsloth/DeepSeek-V3.1-Terminus-GGUF:Q2_K_XL
got error
pull model manifest: 400: {"error":"The specified tag is a sharded GGUF. Ollama does not support this yet. Please use another tag or "latest". Follow this issue
for more info: https://github.com/ollama/ollama/issues/5245"}
how can I handle it?
if manually download all pars to host and use gguf-split --merge, then we need to create Modelfile
What is its correct content must be?