GGUF
#1
by Ttimofeyka - opened
Can you publish GGUF-quantized files? I see them in your profile for older versions, but not for the latest one.
Yeah no worries - just finished 🙂, just wasn't sure if anyone was interested in them.
jsfs11 changed discussion status to closed
In theory, according to benchmarks, this is about the best 4x7B model for chat (RP).