QAT-IT models
#5
by TheChola - opened
Any plans on releasing QAT-IT models just like gemma 3 ?
+1 (subscribing)
Thanks! IMO it's also worth considering nvfp4 versions instead of or in addition to the usual int4.
+1 vLLM support for QAT-IT models if you guys consider. Thanks