GGUF
conversational

Exit code: 18446744072635812000

#2
by E7Reine - opened

Hello, I downloaded the Q4_K_M model from LM Studio, I have 32 GB of RAM and 4 Video Memory, which is partially offloading that only the CPU does not help, although I updated llamacpp all components and the program itself to the latest version 0.4.4 and still there is such an error, what am I doing wrong?
P.s: I have disabled the option : Save the model in memory

(Exit code: 18446744072635812000). Unknown error. Try a different model and/or config.

Solved: It was necessary to enable "mmap()"

Sign up or log in to comment