Dwq quant

#6
by sm54 - opened

Could you make a dwq quant of this model? I tried the nvfp4 but it doesn't perform better then the standard 4bit.

Sign up or log in to comment