GLM-5.1 — 420GB (MLX)

Mixed-precision quantized version of zai-org/GLM-5.1 optimised by baa.ai using a proprietary Black Sheep AI method.

Per-tensor bit-width allocation via advanced sensitivity analysis and budget-constrained optimisation — no calibration data required.

Sized for 512GB Apple Silicon machines (378 GB model + 134 GB headroom for OS/KV cache).

Metrics

Metric Value
Size 382 GB
Average bits 3.6
Architecture MoE (256 experts)

Usage

from mlx_lm import load, generate

model, tokenizer = load("baa-ai/GLM-5.1-RAM-420GB-MLX")
response = generate(model, tokenizer, prompt="Hello!", max_tokens=256)
print(response)

Quantized by baa.ai

Downloads last month
3,311
Safetensors
Model size
744B params
Tensor type
BF16
·
U32
·
F32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for baa-ai/GLM-5.1-RAM-420GB-MLX

Base model

zai-org/GLM-5.1
Quantized
(26)
this model

Collection including baa-ai/GLM-5.1-RAM-420GB-MLX