llama-server cannot load vision projector
#1
by rosspanda0 - opened
0.09.381.236 E clip_init: failed to load model '/home/yl/Downloads/mmproj-Step3-VL-10b-F16.gguf': load_hparams: unknown projector type: step3vl
I'm still in the process of getting the modified llama.cpp code into a PR, I'm putting models which are working with it in this repo. Please stand by
seanbailey518 changed discussion status to closed
awesome! can you share your fork?
Yup! Doing some final tests on the mmproj and I'll have the fork up in a jiffy