Huihui-Qwen3.5-35B-A3B-abliterated-4bit-MLX
This is a 4-bit quantized MLX version of huihui-ai/Qwen3.5-35B-A3B-abliterated, a vision-language model based on Qwen3.5-35B-A3B with abliteration applied to remove refusal behavior.
Usage
mlx-vlm generate --model AITRADER/Huihui-Qwen3.5-35B-A3B-abliterated-4bit-MLX --prompt "Describe this image." --image <path_to_image>
- Downloads last month
- 476
Model size
6B params
Tensor type
BF16
路
U32 路
F32 路
Hardware compatibility
Log In to add your hardware
4-bit