Koboldcpp can't load the GGUF variants of this model

#25

by IggyLux - opened Mar 15

Mar 15

I use the GUI version of Koboldcpp and everytime it tries to load the gguf it just fails to load closing Koboldcpp.

I'd love to test it. Any guidance on this would be helpful.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment