Please make nvfp4 quant and make mlx version of that quant
#1
by Narutoouz - opened
thanks for making the fp8 quant.
Thanks for the suggestion!
We have some good news regarding nvfp4 — it is currently work-in-progress internally, so please stay tuned for the upcoming update!
As for the mlx version, we don't have immediate plans at the moment, but we've passed your request to our team to review its feasibility for future releases.
Thanks again for your interest in our work!
A Solar-Open NVFP4 version quantized using NotaMoEQuant is now available.
https://huggingface.co/nota-ai/Solar-Open-100B-NotaMoEQuant-NVFP4