Qwen3-VL-8B-Instruct-heretic-gguf

Overview

This repository provides a GGUF quantized builds of Qwen3-VL-8B-Instruct-heretic for llama.cpp.

This model is a decensored derivative of the official Qwen/Qwen3-VL-8B-Instruct,
modified using Heretic v1.1.0.

Quantization Details

• Backend: llama.cpp
• Commit: 7537 (e68c19b0f)
• Method: Q4_K_M for weights, FP16 for multimodal adapter
• Imatrix Optimization: [x]️ (custom dataset)