QAT-IT models

#5
by TheChola - opened

Any plans on releasing QAT-IT models just like gemma 3 ?

+1 (subscribing)

Hi @rnett3 @TheChola
Thanks for the interest in Gemma 4 . We've forwarded your request for QAT-IT models to the concerned team.

Thanks! IMO it's also worth considering nvfp4 versions instead of or in addition to the usual int4.

+1 vLLM support for QAT-IT models if you guys consider. Thanks

Sign up or log in to comment