[Question] Ideal Vram and Ram distribution
#1
by muratowski - opened
In order to run Q4 models efficiently and fairly quickly, how much vram and CPU ram should be distributed simultaneously in Ollama for PC?
muratowski changed discussion title from Ideal Vram and Ram distribution to [Question] Ideal Vram and Ram distribution