altomek
/

Qwen3.5-35B-A3B-XXL-GGUF

Image-Text-to-Text

Model card Files Files and versions

Qwen3.5-35B-A3B

XXL GGUF quant of https://huggingface.co/Qwen/Qwen3.5-35B-A3B

MoE models degrade fast in qunats, tried to keep all important layers in BF16.

REUPLOAD with even more BF16 and Q4 & Q5 - Q6 was a little to big.

Downloads last month: 92

GGUF

Model size

35B params

Architecture

qwen35moe

Hardware compatibility

Log In to add your hardware

Model tree for altomek/Qwen3.5-35B-A3B-XXL-GGUF

Base model

Qwen/Qwen3.5-35B-A3B-Base

Finetuned

Qwen/Qwen3.5-35B-A3B

Quantized

(240)

this model

Collection including altomek/Qwen3.5-35B-A3B-XXL-GGUF

XXL GGUF

Inspired by Unsloth XL quants, I started mastering my own GGUF quants with gool to make them even better then XL ones. • 13 items • Updated 5 days ago