Where IQ quantize?
#1
by lingyezhixing - opened
title
Now it's available and updated! @lingyezhixing
I've been wondering for a long time why IQ3_XXS, IQ2_XXS, etc., all have UD dynamic quantization, but the IQ4_XS, which has the most balanced performance and size, doesn't? Is it due to some technical issues?
Now it's available and updated! @lingyezhixing
Thank you anyway, and I would be very grateful if dynamic quantization could be created for IQ4_XS as well
Hello, iq1 tq1?)))
Dec 29th 2025: Just did it so sorry - we had to investigate why imatrix made it go in repetitions - now it's fixed!