Vision removed in this one ?
Now sure how these are created and what are limitations but I remember v2 works with vision as well
Wait, that makes no sense as vision seems to work, and there is a mmproj model in the repo.
Testing the model also shows that vision was not removed. I think hugging face is mislabeled that this is text-only.
... Unless you can clarify that there's no vision.
Ah , I'm using LM studio
Didn't know about mmproj model part
Looks like this repo is missing config.json to enable vision support.
Sorry for the late response!
LM Studio does require the mmproj file when loading a multimodal model, but it isn’t included in the default package.
In the repository, there is a file named mmproj-BF16.gguf. Just place it in the same folder as the model, and LM Studio will be able to recognize the vision component.
😄
The multimodal projection layer is essential for LM Studio to recognize images, perform vision reasoning, and properly load multimodal models.
Hello all, i download file
mmproj.gguf and rename to mmproj-BF16.gguf, then copy to lm studio model folder. It's worked!
Hello all, i download file
mmproj.gguf and rename to mmproj-BF16.gguf, then copy to lm studio model folder. It's worked!
Same here, works fine!
Hello all, i download file
mmproj.gguf and rename to mmproj-BF16.gguf, then copy to lm studio model folder. It's worked!
Thank you