Qwen / Qwen3.5-2B

QUANTIZED BY: UnstableLlama

Information

⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 `dev` branch)
exl3 quantizations of Qwen3.5-2B via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.10bpw	2.26	0.2965	15.8161
3.10bpw	2.42	0.0593	13.1512
4.00bpw	2.56	0.0140	12.3285
5.00bpw	2.72	0.0041	12.2906
6.00bpw	2.88	0.0013	12.1723
8.00bpw	3.20	0.0004	12.1875
bf16	4.24	0.0000	12.1829

CLI Download

hf download UnstableLlama/Qwen3.5-2B-exl3-4.00bpw --local-dir ./Qwen3.5-2B-exl3-4.00bpw

Downloads last month: 124

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/Qwen3.5-2B-exl3-8.00bpw

Base model

Qwen/Qwen3.5-2B-Base

Finetuned

Qwen/Qwen3.5-2B

Quantized

(82)

this model