metadata
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
numind/NuExtract3-mlx-mxfp8
MLX quantized version of numind/NuExtract3.
Quantization
- mode:
mxfp8 - group_size:
32 - bits:
8 - dtype:
source/default - quant_predicate:
none
Usage
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-mxfp8 --prompt "your prompt"