Qwopus3.5-9B-v3-GGUF and LM Studio
Hello, I'm not quite sure where to turn. I found an error in LM Studio. The model's description on the website states that it works with text and images. This information is also confirmed when downloading the model in LM Studio, but the model itself does not work with images. To be honest, I don't know whose fault this is. Is it in LM Studio or in the description on the website https://huggingface.co/Jackrong/Qwopus3.5-9B-v3-GGUF? I wanted to share this because I don’t know if everything works normally and as intended in other environments, such as Ollama, for example.
I’ve attached screenshots with proof below.
I found this comment on the fb: " LM Studio is missing the mmproj file, sir. You need to download the individual file from Huggingface, put it in the same folder as the model file, and rename it to mmproj-BF16. LM Studio will then automatically recognize it. ".
Sorry for the late response!
What that gentleman said is absolutely correct. LM Studio does require the mmproj file when loading a multimodal model, but it isn’t included in the default package. In the repository, there is a file named mmproj-BF16.gguf. Just place it in the same folder as the model, and LM Studio will be able to recognize the vision component.
Thank you so much; I'm glad you answered my question. I downloaded it from the repository and did exactly as you said. That solved the problem.
Thanks again :)