exl2 + cohere2 stable now?
#1
by fizzacles - opened
I'm sorry for the confusion, i thought CMD-A's model architecture had some stability issues in exl2 format? Do you know if it's usable or stable now?
Hi, just noticed your message here.
Nope, Cohere2 models are still broken in exl2. It's been fixed in exllamav3 since v0.06 though, so I'd recommend this quant: