dealignai/MiniMax-M2.5-REAP-172B-4bit-MLX-CRACK
Text Generation • 173B • Updated • 439 • 2
CRACK abliterated MiniMax M2.5 REAP models — 139B and 172B at 4/6/8-bit MLX.
Note 172B 4-bit (90 GB) — 8/8+3/3 compliance, 51 tok/s
Note 172B 6-bit (131 GB) — 8/8+3/3 compliance, 42 tok/s
Note 172B 8-bit (171 GB) — 8/8+3/3 compliance, 38 tok/s
Note 139B 4-bit (69 GB) — ~19/24 compliance, 50 tok/s
Note 139B 6-bit (101 GB) — ~19/24 compliance, 41 tok/s
Note 139B 8-bit (134 GB) — ~19/24 compliance, 37 tok/s
Note JANG_2L CRACK (63 GB) — 98.1% HarmBench, 84.7% MMLU (+10.2% improved!). Fits 96 GB Macs.