Great work, really needed something like this.
Noticed its for mlx, is there one that's vllm compatible? Or at least a way that this one can be adapted
· Sign up or log in to comment
