How to use NemoTLS/Hy3-preview-oQ6 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Hy3-preview-oQ6 NemoTLS/Hy3-preview-oQ6
library_name: mlx tags: - mlx - oq - quantized
This model was quantized using oQ (oMLX v0.3.6) mixed-precision quantization.