EXL3 quants still unavailable
#1
by cactopus - opened
As titled, EXL3 quants in the description still appear to have a dead link
Would love to try it out otherwise
Not sure if you ever got around to making your own quants, but I uploaded some exl3 quants here: https://huggingface.co/MikeRoz/Anubis-70B-v1.2-exl3
Not sure if you ever got around to making your own quants, but I uploaded some exl3 quants here: https://huggingface.co/MikeRoz/Anubis-70B-v1.2-exl3
Damn that's thorough, covered pretty much everything
What a champ. This should be linked on the cover page xD