AWQ 4/5/6-bit request for Qwopus3.5-27B-v3
#2
by celikburak - opened
Hi mconcat,
Jackrong just released Qwopus3.5-27B-v3.
Could you please make AWQ 4-bit, 5-bit and 6-bit quants when you have time?
We’re running on 5090 with vLLM + FlashInfer and your previous quants worked great.
Thanks in advance!