Request for AWQ 4-bit quant of Qwopus3.5-27B-v3
#5
by celikburak - opened
Hi Jackrong,
Thanks for the great Qwopus3.5-9B-v3.
I saw you're working on the 27B version right now. Any chance you could also release an AWQ 4-bit quant once it's ready?
It would be really helpful for vLLM users running on 5090.
Appreciate all your hard work!
check cpatonn/Qwopus3.5-9B-v3-AWQ-4bit, they hosted various quantizazion size too