MLX or NVFP4?

#1
by thelifeandtimes - opened

The model name is ...-MLX-nvfp4, the tag is mlx but also nvfp4? What should I understand about these designations being on the same repo?

The MLX framework supports NVFP4 quantization, so this should be understood as "an MLX model with NVFP4 quantization"

Ah, thanks.

TheCluster changed discussion status to closed

Sign up or log in to comment