YandexGPT
Collection
2 items • Updated
This model was converted to MLX format from yandex/YandexGPT-5-Lite-8B-instruct using mlx-lm version 0.30.7:
mlx_lm.convert --hf-path yandex/YandexGPT-5-Lite-8B-instruct --mlx-path deepsweet/YandexGPT-5-Lite-8B-Instruct-MLX-MXFP4 --quantize --q-mode mxfp4 --q-group-size 32
- Downloads last month
- 153
Model size
2B params
Tensor type
U8
·
U32 ·
F16 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for deepsweet/YandexGPT-5-Lite-8B-Instruct-MLX-MXFP4
Base model
yandex/YandexGPT-5-Lite-8B-pretrain Finetuned
yandex/YandexGPT-5-Lite-8B-instruct