Hugging Face's logo

Qwen
/
Qwen2-VL-7B-Instruct

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_vl
multimodal
conversational
Eval Results
text-generation-inference
Model card Files
xet
 Community
87

Are GGUF models available?

#24
by smcleod - opened
Discussion
smcleod

Really excited to try this out but I can't find GGUF models anywhere so it can be run with llama.cpp/ollama/lm-studio etc....

PranavSharma10

No, they aren't
apepkuss79

https://huggingface.co/collections/second-state/qwen2-vl-gguf-models-675ff2389a291a38da0a0fcf
smcleod

I forgot to come by and say thanks @apepkuss79 🙏

smcleod changed discussion status to closed

Sign up or log in to comment