only ct2 int8 convert
ct2-transformers-converter --model facebook/nllb-200-distilled-600M --quantization int8 --trust_remote_code --output_dir nllb-200-distilled-600M-ct2-int8
Original author: Facebook
Original author model URL: facebook/nllb-200-distilled-600M
- Downloads last month
- 20
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support