Older quants get in the way
#1
by KeyboardMasher - opened
@bartowski I believe you forgot to remove the old IQ2_S and IQ3_XXS quants.
Also, Q4_1-00004-of-00007.gguf is from the older version while the rest are newer, possibly breaking the whole thing.
Shoot i didn't notice that or this message D:
Thank you!!!
Q4_1 should be fine, likely that that split just happened to be identical before/after my latest changes, but will download now to double check and update
Okay confirmed Q4_1 fresh download is totally fine, just one of the files had no changes from one upload to the next :)