--- license: apache-2.0 base_model: sapientinc/HRM-Text-1B library_name: mlx pipeline_tag: text-generation inference: false tags: - mlx - apple-silicon - text-generation - bf16 - hrm - reasoning --- # HRM-Text-1B MLX BF16 This is a BF16 MLX checkpoint for [sapientinc/HRM-Text-1B](https://huggingface.co/sapientinc/HRM-Text-1B). It is intended for use with [HRM-mlx](https://github.com/Aryagm/HRM-mlx) on Apple Silicon. This is not a new finetune. It is a format conversion of the public HRM-Text-1B weights for native MLX inference. The checkpoint keeps the full HRM recurrent inference loop: ```text H_cycles * (L_cycles + 1) = 2 * (3 + 1) = 8 stack passes/token ``` ## Files - `model.safetensors`: MLX-format BF16 weights - `config.json`: HRM-Text config with MLX metadata - `tokenizer.json`, `tokenizer_config.json`: tokenizer files copied from the base model ## Usage ```bash git clone https://github.com/Aryagm/HRM-mlx.git cd HRM-mlx python3 -m venv .venv source .venv/bin/activate pip install -e . ``` Download this checkpoint: ```bash python - <<'PY' from huggingface_hub import snapshot_download snapshot_download( repo_id="Aryagm/HRM-Text-1B-MLX-BF16", local_dir="exports/hrm-text-1b-mlx-bf16", ) PY ``` Generate: ```bash hrm-mlx \ --model-dir exports/hrm-text-1b-mlx-bf16 \ --prompt '<|im_start|><|quad_end|><|object_ref_end|>What is the derivative of (x^2) / ln(x)? Give the final simplified expression.<|im_end|>' \ --max-tokens 420 \ --temperature 0.0 \ --dtype bfloat16 \ --metal-swiglu ``` Expected final expression: ```text x(2 ln(x) - 1) / (ln(x))^2 ``` ## Benchmark On a MacBook Pro M4 Max, 32-core GPU, this checkpoint reaches about 28 decode tokens/sec with HRM-mlx's BF16 path. Benchmark shape: 512 prompt tokens, 128 generated tokens. Absolute numbers vary by chip and system load. ## Notes For faster decode and a smaller download, use the [4-bit MXFP4 checkpoint](https://huggingface.co/Aryagm/HRM-Text-1B-MLX-4bit). HRM-Text-1B is a base reasoning model, not a polished chat assistant. It can produce incomplete or unstable answers on some prompts, especially when the prompt is underspecified or contradictory.