Qwen
/

Qwen3-VL-30B-A3B-Instruct-FP8

Image-Text-to-Text

Model card Files Files and versions

gguf quantization

#2

by Pragg100510 - opened Oct 5, 2025

Can I get this in gguf quantization?

•

edited Oct 5, 2025

What you're going to do with GGUF?

Qwen3-VL is not supported by llama.cpp yet

Why? Where as Qwen 2.5 vl does.

https://github.com/ggml-org/llama.cpp/issues/16207

Thanks

Pragg100510 changed discussion status to closed Oct 5, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment