need
As the 27B is a dense model, it won't benefit from the MXFP4 quantization.
· Sign up or log in to comment