Could you make a dwq quant of this model? I tried the nvfp4 but it doesn't perform better then the standard 4bit.
· Sign up or log in to comment