Qwen
/

Qwen3-235B-A22B

Text Generation

Model card Files Files and versions

GPTQ/AWQ

#3

by ndurkee - opened Apr 28, 2025

Are there plans to add GPTQ/AWQ versions like in the past?

https://github.com/casper-hansen/AutoAWQ

Also, are there any plan for official gguf?

https://modelscope.cn/models/swift/Qwen3-235B-A22B-AWQ

Here is a quantized version (Unofficial)

Expecting to support gptq quantization would be a great benefit for V100

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment