How to use from
Hermes Agent
Start the MLX server
# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "bearzi/MiniMax-M2.7-JANG_2L"
Configure Hermes
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default bearzi/MiniMax-M2.7-JANG_2L
Run Hermes
hermes
Quick Links

MiniMax-M2.7-JANG_2L

JANG adaptive mixed-precision MLX quantization produced via vmlx / jang-tools.

  • Quantization: 2.1b avg, profile JANG_2L, method mse-all, calibration activations
  • Profile: JANG_2L
  • Format: JANG v2 MLX safetensors
  • Compatible with: vmlx, MLX Studio, oMLX (with JANG patch)

Usage

vmlx (recommended)

pip install 'vmlx[jang]'
vmlx serve bearzi/MiniMax-M2.7-JANG_2L

Python

from jang_tools.loader import load_jang_model
from mlx_lm import generate

model, tokenizer = load_jang_model("bearzi/MiniMax-M2.7-JANG_2L")
messages = [{"role": "user", "content": "Hello"}]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
print(generate(model, tokenizer, prompt=prompt, max_tokens=512, verbose=True))

About JANG

JANG (Jang Adaptive N-bit Grading) assigns different bit widths to different layer types — attention layers get more bits, MLP/expert layers compress harder. This preserves model coherence at aggressive compression levels where uniform quantization breaks down.

See JANG documentation and scores at jangq.ai.

Comparative benchmarks and feedback welcome — please open a discussion.

Downloads last month
318
Safetensors
Model size
19B params
Tensor type
U32
·
F16
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bearzi/MiniMax-M2.7-JANG_2L

Quantized
(108)
this model

Collection including bearzi/MiniMax-M2.7-JANG_2L