AWQ-8bit?
#1
by boshko - opened
Thanks for the quantization in 4-bit!
Are you planning to quantize this model using AWQ-8bit?
Thank you for your interests. It is already in progress and should be done in the next 24 hours :)
Thank you!
boshko changed discussion status to closed