No MMPROJ?
#1
by YearZero - opened
How come no MMPROJ file for the "i" version? Can I take the one from the regular GGUF and would it be just as good for this version?
The imatrix only applies to the LLM stack of the model and is irrelevant for the vision stack. Because of this no mmproj files are provided for weighted/imatrix quants as it would be the same exact file as for static quants. Please use the mmproj files in the static quant repository even if you use the much better weighted/imatrix quants for the LLM stack.
Ok awesome just making sure, thank you!
YearZero changed discussion status to closed