stanzhou/Qwen3-0.6B-VQ-w4a16
0.6B • Updated • 1
VQRound
The model collection of paper: Revisiting Adaptive Rounding with Vectorized Reparameterization for LLM Quantization
-
-
stanzhou/Qwen3-0.6B-VQ-GPTQ-w4a16
0.6B • Updated -
stanzhou/Qwen3-1.7B-VQ-w4a16
2B • Updated • 1 -
stanzhou/Qwen3-1.7B-VQ-GPTQ-w4a16
2B • Updated • 2 -
stanzhou/Qwen3-4B-VQ-w4a16
4B • Updated -
stanzhou/Qwen3-4B-VQ-GPTQ-w4a16
4B • Updated -
stanzhou/Qwen3-8B-VQ-w4a16
8B • Updated -
stanzhou/Qwen3-8B-VQ-GPTQ-w4a16
8B • Updated -
stanzhou/Llama-7B-VQ-w4a16
7B • Updated -
stanzhou/Llama-7B-VQ-w3a16
7B • Updated -
stanzhou/Llama-7B-VQ-w2a16
7B • Updated -
stanzhou/Llama-13B-VQ-w4a16
13B • Updated • 1 -
stanzhou/Llama-13B-VQ-w3a16
13B • Updated • 2 -
stanzhou/Llama-13B-VQ-w2a16
13B • Updated • 1 -
stanzhou/Llama2-7B-VQ-w4a16
7B • Updated -
stanzhou/Llama2-7B-VQ-w3a16
7B • Updated -
stanzhou/Llama2-7B-VQ-w2a16
7B • Updated -
stanzhou/Llama2-13B-VQ-w4a16
13B • Updated -
stanzhou/Llama2-13B-VQ-w3a16
13B • Updated -
stanzhou/Llama2-13B-VQ-w2a16
13B • Updated • 4 -
stanzhou/Llama-7B-VQ-GPTQ-w4a16
7B • Updated -
stanzhou/Llama-7B-VQ-GPTQ-w3a16
7B • Updated -
stanzhou/Llama-7B-VQ-GPTQ-w2a16
7B • Updated -
stanzhou/Llama-13B-VQ-GPTQ-w4a16
13B • Updated -
stanzhou/Llama-13B-VQ-GPTQ-w3a16
13B • Updated -
stanzhou/Llama-13B-VQ-GPTQ-w2a16
13B • Updated -
stanzhou/Llama2-7B-VQ-GPTQ-w4a16
7B • Updated -
stanzhou/Llama2-7B-VQ-GPTQ-w3a16
7B • Updated -
stanzhou/Llama2-7B-VQ-GPTQ-w2a16
7B • Updated -
stanzhou/Llama2-13B-VQ-GPTQ-w4a16
13B • Updated -
stanzhou/Llama2-13B-VQ-GPTQ-w3a16
13B • Updated -
stanzhou/Llama2-13B-VQ-GPTQ-w2a16
13B • Updated • 2 -
stanzhou/OPT-125M-VQ-w4a16
0.1B • Updated • 5 -
stanzhou/OPT-350M-VQ-w4a16
0.3B • Updated -
stanzhou/OPT-1.3B-VQ-w4a16
1B • Updated -
stanzhou/OPT-2.7B-VQ-w4a16
3B • Updated -
stanzhou/OPT-6.7B-VQ-w4a16
7B • Updated -
stanzhou/OPT-125M-VQ-GPTQ-w4a16
0.1B • Updated • 1 -
stanzhou/OPT-13B-VQ-w4a16
13B • Updated -
stanzhou/OPT-350M-VQ-GPTQ-w4a16
0.3B • Updated -
stanzhou/OPT-1.3B-VQ-GPTQ-w4a16
1B • Updated • 1 -
stanzhou/OPT-2.7B-VQ-GPTQ-w4a16
3B • Updated • 1 -
stanzhou/OPT-6.7B-VQ-GPTQ-w4a16
7B • Updated • 1 -
stanzhou/OPT-13B-VQ-GPTQ-w4a16
13B • Updated • 1 -
stanzhou/OPT-125M-VQ-w3a16
0.1B • Updated • 2 -
stanzhou/OPT-350M-VQ-w3a16
0.3B • Updated -
stanzhou/OPT-1.3B-VQ-w3a16
1B • Updated -
stanzhou/OPT-2.7B-VQ-w3a16
3B • Updated -
stanzhou/OPT-6.7B-VQ-w3a16
7B • Updated -
stanzhou/OPT-125M-VQ-GPTQ-w3a16
0.1B • Updated -
stanzhou/OPT-13B-VQ-w3a16
13B • Updated • 1 -
stanzhou/OPT-350M-VQ-GPTQ-w3a16
0.3B • Updated -
stanzhou/OPT-1.3B-VQ-GPTQ-w3a16
1B • Updated • 1 -
stanzhou/OPT-2.7B-VQ-GPTQ-w3a16
3B • Updated • 1 -
stanzhou/OPT-6.7B-VQ-GPTQ-w3a16
7B • Updated • 1 -
stanzhou/OPT-13B-VQ-GPTQ-w3a16
13B • Updated • 2