Qwen / Qwen3.5-4B-exl3

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of Qwen3.5-4B-exl3 via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.00bpw	3.09	0.3653	12.2025
2.10bpw	3.13	0.2848	11.4102
3.00bpw	3.51	0.0631	9.9813
3.10bpw	3.54	0.0584	9.8489
4.00bpw	3.92	0.0187	9.6894
5.00bpw	4.34	0.0060	9.6490
6.00bpw	4.75	0.0020	9.6689
8.00bpw	5.58	0.0010	9.6854
bf16	8.68	0.0000	9.6736

CLI Download

hf download UnstableLlama/Qwen3.5-4B-exl3-4.00bpw --local-dir ./Qwen3.5-4B-exl3-4.00bpw

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/Qwen3.5-4B-exl3-2.00bpw

Base model

Finetuned

Quantized

(144)

this model