Qwen3.5-35B-A3B-heretic-v3-GGUF
GGUF quantizations of the abliterated weights.
Files
| Quant | imatrix | UD map |
|---|---|---|
| Q8_0 | No | No |
| Q6_K_XL | Yes | Yes |
| Q4_K_XL | Yes | Yes |
| IQ4_NL | Yes | Yes |
| IQ4_XS | Yes | Yes |
Source
- Original model: unsloth/Qwen3.5-35B-A3B
- imatrix calibration: bartowski calibration_datav5
Related
- Full-precision abliterated weights: Qwen3.5-35B-A3B-heretic-v3
- Downloads last month
- 968
Hardware compatibility
Log In to add your hardware
4-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for meangrinch/Qwen3.5-35B-A3B-heretic-v3-GGUF
Base model
Qwen/Qwen3.5-35B-A3B-Base Finetuned
Qwen/Qwen3.5-35B-A3B Finetuned
unsloth/Qwen3.5-35B-A3B Finetuned
meangrinch/Qwen3.5-35B-A3B-heretic-v3