Guys please add the MTP to this model

#50
by Narutoouz - opened

It is a crime for not putting MTP in this model. All inference providers will add support for them. This is such a good model to miss that tech.
Thankyou

Add it for 26b a4 model also.
Thankyou

Always good to have, of course. But reality is that MTP support, especially in lcpp, is non existent. I would like Google and Qwen to help llama.cpp implementing support for it.

Sign up or log in to comment