Is IQ4_XS the same with IQ4_NL? I open IQ4_XS layers using IQ4_NL. Could you update IQ4_XS? Thank you very much.
Ah, because of how IQ4_XS works it can't actually be used on nemotron's tensor shape it seems, so they all had to fallback to IQ4_NL...
Β· Sign up or log in to comment