plawanrath/phi-3.5-mini-instruct-q3-mlx-cba
Text Generation • 0.5B • Updated • 158
Quantization Undoes Alignment — IEEE Cloud Summit 2026
MLX artifacts for the IEEE Cloud Summit 2026 paper. 3 LLMs × 5 precisions (BF16/Q8/Q6/Q4/Q3, gs=64).
-
-
plawanrath/phi-3.5-mini-instruct-q4-mlx-cba
Text Generation • 0.6B • Updated • 46 -
plawanrath/phi-3.5-mini-instruct-q6-mlx-cba
Text Generation • 0.8B • Updated • 27 -
plawanrath/mistral-7b-instruct-v0.3-q3-mlx-cba
Text Generation • 0.9B • Updated • 43 -
plawanrath/qwen2.5-7b-instruct-q3-mlx-cba
Text Generation • 1.0B • Updated • 19 -
plawanrath/mistral-7b-instruct-v0.3-q4-mlx-cba
Text Generation • 1B • Updated • 40 -
plawanrath/phi-3.5-mini-instruct-q8-mlx-cba
Text Generation • 1B • Updated • 33 -
plawanrath/qwen2.5-7b-instruct-q4-mlx-cba
Text Generation • 1B • Updated • 23 -
plawanrath/mistral-7b-instruct-v0.3-q6-mlx-cba
Text Generation • 7B • Updated • 48 -
plawanrath/qwen2.5-7b-instruct-q6-mlx-cba
Text Generation • 8B • Updated • 20 -
plawanrath/phi-3.5-mini-instruct-bf16-mlx-cba
Text Generation • 4B • Updated • 50 -
plawanrath/mistral-7b-instruct-v0.3-q8-mlx-cba
Text Generation • 7B • Updated • 99 -
plawanrath/qwen2.5-7b-instruct-q8-mlx-cba
Text Generation • 8B • Updated • 25 -
plawanrath/mistral-7b-instruct-v0.3-bf16-mlx-cba
Text Generation • 7B • Updated • 139 -
plawanrath/qwen2.5-7b-instruct-bf16-mlx-cba
Text Generation • 8B • Updated • 15