Any chance of an MLX release?

#4
by KeenZZZ - opened

Hi, thanks for sharing the model.

Any chance you could provide an official MLX version for Apple Silicon / mlx-lm users?

The GGUF files are useful, but a native MLX release would be much easier for Mac users. An 8-bit MLX version would be great.

If not, would it be possible to provide the original Transformers-format weights so the community can convert it properly?

Thanks.

Hello,

For my first few releases I did do the safetensors but due to some bad actors, that has been something I stopped since as I put a LOT of time and resources into these. MLX releases will happen when I will acquire a Mac.

Thanks for the reply, and also for all the time, effort, and resources you put into releasing these models.
I completely understand your concern. Looking forward to your future MLX releases !

KeenZZZ changed discussion status to closed

Sign up or log in to comment