fix(deploy): symlink hf preloads into fork's checkpoint dir + strip prompt tokens in lyrics 03ddd85 unverified techfreakworm commited on 2 days ago
fix(lyrics): re-create mlx_lm generation_stream in worker thread 0d2d5a8 unverified techfreakworm commited on 2 days ago
fix(lyrics): wrap mlx-lm generate in mx.stream(mx.gpu) for Gradio worker threads a81cc03 unverified techfreakworm commited on 2 days ago
feat(lyrics): add qwen 2.5 7b lazy loader with mlx and transformers backends 9c07a74 unverified techfreakworm commited on 2 days ago