What have you done to the model?
#8
by madmax0404 - opened
It's worse than the mxfp4 version. It repeats gibberish and worse at tool calling.
I'm sorry. I didn't know dequantization makes models worse.
madmax0404 changed discussion status to closed