Any mimi trained project recommended to fully utilize this with Japanese?

#1
by RinRin32 - opened

I tried retrofitting it with dsm tts it works really well and the audio quality is really good, just that the current checkpoint out is not in Japanese so my test was limited. Do you have other recommended opensource tts projects I can look into to giving this a try? Or is the state really that there's no TTS with good Japanese support that happens to be trained using mimi encoder.

Owner

Hi.

Unfortunately I do not know of any speech generation model in Japanese that uses mimi.

(There's J-moshi which I guess it used mimi, however since it was trained on J-Chat and J-chat is a dataset of poor quality you won't get the benefits.)

Sign up or log in to comment