Text Generation
Transformers
GGUF
conversational

Q2_K_XL broken on llama.cpp 5cca2542ac3f3f86831d32bce744d08fc2b353b0

#2
by mikehenderson976 - opened

Hi,

Just tried this on latest llama.cpp commit. It just prints out question marks. Anyone have any luck running the Q2_K_XL?

Thanks!

Unsloth AI org

We just reuploaded them. The hugging face/AWS blackout broke the uploads btw

CC: @mikehenderson976

Sign up or log in to comment