when running model inside ollama created from the gguf, getting errors

#1
by mayankiit04 - opened

Hi

This is the error seen on 0.15.6 ollama
Error: 500 Internal Server Error: llama runner process has terminated: error loading model: missing tensor 'blk.0.ssm_in.weight'
llama_model_load_from_file_impl: failed to load model

Do we need to wait for a new ollama release that will be able to work the reap gguf?

Sign up or log in to comment