Not able to load the model in Ollama

#14
by gulaz - opened

Hi,
I have downloaded Gemma-4-E4B-Uncensored-HauhauCS-Aggressive:Q6_K_P as well as Q4_K_M, but neither of them cannot be loaded to Ollama. I just get generic error: 500 Internal Server Error: unable to load model: C:\Users\lukas.ollama\models\blobs\sha256-f28b0ae262158af10d847c3f01bfdb943161dd31320f3aed20775ee2ad6c67a6

I should have decent HW to run the models I suppose:
32GB RAM
12GB VRAM (RTX 5070)
Windows 11

Thanks for any suggestions,

I'm having the same issue as @gulaz
96GB RAM
24GB VRAM(RTX4090)
Ubuntu

+1 the same issue

32Gb RAM
16Gb VRAM (laptop RTX 5080)
The official gemma4:e4b from ollama registry works no problem.
TrevorJS's version works, too - but currently only Q4 is available to download for ollama.

Same problem with many models of this (and not only this) author + ollama
64Gb RAM, Intel i5-12600KF
16Gb VRAM, RTX 5080

Sign up or log in to comment