Could you share the code script that convert the original Qwen3-8B to Qwen3-8B-AWQ?
#1
by wenmin-wu - opened
Hi stelterlab, thanks for sharing this model, could you share the code script that convert the original Qwen3-8B to Qwen3-8B-AWQ? Just wanna take a look to learn from it.
Hi!
Yes, of course. It the example right from the README of the AutoAWQ project I use.
https://github.com/casper-hansen/AutoAWQ/blob/main/examples/quantize.py
Make sure that you use the version from the main branch when you use it on Qwen3 which contain this PR https://github.com/casper-hansen/AutoAWQ/pull/751.