support for Ollama

#17
by mineworkshare - opened

ollama run nous-hermes-llama2
pulling manifest
Error: pull model manifest: file does not exist

Please help

you can download the GGUF manually and write a 1-line modelfile to make the quant loadable by ollama

Sign up or log in to comment