the size of vision model is still large, is there anyway to reduce size to less than 1GB

#1
by yimlin - opened

the size of vision model is 1.8GB, it seems no less than the origin model which is 1.9GB

Oops, I'll check it later... (Probably in a week, since I'm currently out of town...

@yimlin Sorry for the late reply. The reason is that I saved the model parameters using float32, as the original parameters were likely saved with bfloat16.

thanks

yimlin changed discussion status to closed

Sign up or log in to comment