Q4_0 Quant?

#4
by elpirater312 - opened

Q4_0 is a bit faster for pure CPU inference on my experience, would be nice to have. Thank you.

Sign up or log in to comment