Hello noctrex, could you please tell me whether the MXFP4 has better quality or the Q4KM + imatrix quantization?
#3
by Luck0078 - opened
Hello noctrex, could you please tell me whether the MXFP4 has better quality or the Q4KM + imatrix quantization?
Unfortunately, it's difficult to say. We had a lengthy discussion in the smaller model's discussion, and it seemed it would perform a little bit better. But this is something that you must find out according to your workflow.