Error when running Q4 K_M in koboldcpp
#1
by opendev - opened
Koboldcpp crashes when loading Q4 K_M model. Will share the error soon.
Has anyone also encountered this, is there a reason for it?
That looks like the error you expect when you need to update, what version of koboldcpp are you on?
The latest 1.72
Others gguf's, include Llama-3 70B Q4_K_M running well
Update:
It's 1.71. I'll try to update to 1.72 and check.
It's running well with 1.72. Thanks.
opendev changed discussion status to closed