gguf is pretty good yeah, but it would be nice to have exl3 quants available. Thank you, i only say this because exl3 tends to be better for batching.
· Sign up or log in to comment
