Quant Please
#1
by WoolCool - opened
This model has been supported by any quantization method yet? I ran this using hf bitsandbytes
We plan to release the quantization version of the YAYI2 model by the end of this month. Thank you:)
wenge-research changed discussion status to closed