gg000/Cydonia-24B-v4.1-MLX-mixed-4bit
Primarily 4bit, with some 6bit weights. Equivalent to Q4_K_M.
This model gg000/Cydonia-24B-v4.1-MLX-mixed-4bit was converted to MLX format from TheDrummer/Cydonia-24B-v4.1 using mlx-lm version 0.27.1.
- Downloads last month
- 12
Model size
24B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for gg000/Cydonia-24B-v4.1-MLX-mixed-4bit
Base model
TheDrummer/Cydonia-24B-v4.1