mmproj

#1
by linkpharm - opened

Any plans to release a mmproj, or is there one still compatible with this, Such as the official?

still compatible with this

this isn't working on my llama.cpp:

[==================================================] 100% (13232 MB / 13232 MB)
gguf_init_from_file_impl: tensor 'token_embd.weight' has invalid ggml type 44 (NONE)
gguf_init_from_file_impl: failed to read tensor info

Please make sure you use https://github.com/turbo-tan/llama.cpp-tq3 , main branch. Type 44 and 46 are defined in there. It is a fork from llama.cpp, feel free to contribute.

added mmproj for all 3. Suggest to use 4S.

YTan2000 changed discussion status to closed

Sign up or log in to comment