Quantization code for int4(w4a16) ?

#6
by traphix - opened

Do you have a quantization Python script for Qwen3.5 that we can try ourselves?

Sign up or log in to comment