Is possible to see a merged Airoboros-33b-SuperHOT-8k without GPTQ?
#1
by Panchovix - opened
Thanks for amazing work! I want to do some quantizations variations (like group size 32, 64, 128), act order and such.
But for those, I need the .bin files :(
Thanks!
Yep. Ill upload these.
Panchovix changed discussion status to closed