Doesnt run in Lmstudio, JAN, GPT4ALL

#2
by frank0071 - opened

Hi it fails to load the model, I have taken the sha256sum and everything from my side is ok and latest version, could you help sir

Owner

Hi there,
At the time I uploaded this, there was no official GGUF conversion for this model that worked with Ollama. I manually modified the conversion script strictly to make it run on that specific, older version of Ollama.
Because of those custom modifications, it lacks the standard structure required by modern platforms like LM Studio, Jan, or GPT4ALL, which is why it's failing to load for you.
I'm no longer updating or maintaining this repo. Your best bet is to grab a freshly converted GGUF from other active maintainers here on Hugging Face.

Sign up or log in to comment