Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer
Jackrong / Qwopus3.5-27B-v3
Information
4.15bpw exl3 quantization of Qwopus3.5-27B-v3 via
exllamav3.
repo generated automatically with ezexl3.
repo generated automatically with ezexl3.
Repo Data
| REVISION | GiB | KL DIV | PPL |
|---|---|---|---|
| 4.15bpw | 15.93 | 0.0091 | 6.4755 |
| 8.00bpw | 26.83 | 0.0003 | 6.4633 |
| bf16 | 50.96 | 0.0000 | 6.4636 |
excat model signature
CLI Download
hf download UnstableLlama/Qwopus3.5-27B-v3-exl3-4.15bpw --local-dir ./Qwopus3.5-27B-v3-exl3-4.15bpw
- Downloads last month
- 36
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support