Litert ver

#1
by sakumaXIII - opened

Can we please get a LiteRT version of G4-E4B-Musica-v1?

I would like to do that, but I'm unsure how exactly. Google provided no example conversion code for Gemma4 model family, and docs for litert_torch are quite cryptic and unhelpful.

I see, thank you for the respond. Maybe one day hopefully. Either way amazing work.

I've asked Kearm to investigate and attempt the conversion, and he managed to get a working checkpoint, it appears.
It is text-only and not in the neat single-file .litert format, but it appears to work.
https://huggingface.co/allura-forge/G4-E4B-Musica-v1-LiteRT-TFLite

Oh 😳 Good Job! I shared it with my discord community who use LLM models on Layla app. Thank you for the amazing work.

Thanks again, @Kearm

Thank you Kearm for the effort. The Layla app community appreciate it.

Sign up or log in to comment