Where IQ quantize?

#1
by lingyezhixing - opened
Unsloth AI org

Now it's available and updated! @lingyezhixing

Now it's available and updated! @lingyezhixing

I've been wondering for a long time why IQ3_XXS, IQ2_XXS, etc., all have UD dynamic quantization, but the IQ4_XS, which has the most balanced performance and size, doesn't? Is it due to some technical issues?

Now it's available and updated! @lingyezhixing

Thank you anyway, and I would be very grateful if dynamic quantization could be created for IQ4_XS as well

Hello, iq1 tq1?)))

Unsloth AI org

Dec 29th 2025: Just did it so sorry - we had to investigate why imatrix made it go in repetitions - now it's fixed!

Sign up or log in to comment