AWQ-8bit?

#1
by boshko - opened

Thanks for the quantization in 4-bit!
Are you planning to quantize this model using AWQ-8bit?

cyankiwi org

Thank you for your interests. It is already in progress and should be done in the next 24 hours :)

Thank you!

boshko changed discussion status to closed

Sign up or log in to comment