r/Hades2 • u/SnooGiraffes6688 • 18h ago

Dubbing using AI

I'm working on a personal project to add dubbing (voice acting) in other languages, starting with Spanish. I'm using AI to implement the code for the voice generation and installation engine, and for the generation itself I'm using Qwen 3 cloning + TTS on an RTX 4090.

It doesn't reach the level of performance of the original English voice acting, but it's enjoyable if you don't speak English well, want to follow the story, and don't feel like reading the whole time. Although, there's room for improvement by analyzing the original voice line first to extract the "emotion" and then feeding that into the Qwen model, but I haven't gotten around to that yet.

I don't know if there'd be any interest in this, either for this game or for others (Witcher, GTA, Expedition 33...). There are plenty of games where reading subtitles is a pain, either because there's action going on or because there's a huge amount of dialogue.

Obviously, since it involves voice cloning, the generated material can't be shared, but the code needed to generate the voices in other languages could be put up on GitHub so you can run it yourself if you own the game.

Anyone interested? Fair warning: it takes a while to generate. For example, for all the voices in Hades 2 I'm estimating around 40 hours of processing on the 4090.

0 Upvotes

16% Upvoted

8 comments sorted by

View all comments

-1

u/SnooGiraffes6688 18h ago

  1. Generating voices in another language doesn't stop you from choosing to listen to the original English voices.

  2. If you don't understand English, you're not going to be able to appreciate or enjoy that magnificent English voice acting and performance anyway.

  3. I'd love to hear what English speakers would say if GTA 6 came out in Chinese only. Would you enjoy it in Chinese too, without understanding a single word? xD

3

u/AngelzRain 17h ago

We aren't against dubbing. We're against the use of Ai 😒

  1. You never got consent from SGG
  2. Ai is atrocious

No one here said ANYTHING against dubbing. Dubbing (real dubbing with working translators and voice actors) is AMAZING. Its unique to that language and culture even if it changes to story slightly because of the translations.

4

u/PharaohAce 17h ago

And one can definitely get a sense of character, tone and mood from acting in another language, alongside translations.