Have you tried this compression technique?
#1
by infinityai - opened
Have you tried this compression technique from Intel? could be worth testing
https://github.com/intel/auto-round
Have you tried this compression technique from Intel? could be worth testing
https://github.com/intel/auto-round