4bit verson?
#1
by infinityai - opened
Is there any way you could make a four bit version ?
I have a M2 mac with 96 GB of RAM would be good if I could fit this on my machine somehow
Is there a way to compress it down to 70 GB perhaps
How did you actually make these by the way ?
Could you tell me the code that you used to quantise them so well