Bump the bits πŸ™Œ

#1
by McG-221 - opened

Hi there, how did you manage to bump the quant to 8.626 bpw using mxfp8? ✌️

Hi. In this case, I used a regular conversion command (mlx_vlm.convert), without any fancy tricks.

McG-221 changed discussion status to closed

Sign up or log in to comment