cyankiwi

/

Qwen3.5-35B-A3B-AWQ-8bit

like 11

Follow

cyankiwi 433

The VLLM installed in this way can run this model.

git clone https://github.com/vllm-project/vllm.git
cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install --editable .