Is Q8_0 gone?
#16
by PhilippeEiffel - opened
Thanks for the big update.
Before the update, there was a Q8_0 file. Looks like it has been deleted and not replaced.
The Q8_K_XL is roughly 2 GB bigger.
Is it intentional? Was this file somewhat broken?
Will be reuploaded tomorrow, no not broken, we wanted to find the best balance of quantization before we upload it
I can see the new release now. Thank you.