Interpreter – Offline screen translator for Japanese retro games (opens in new tab)

What translation quality can be expected form such "tiny" model, especially for older games with text only in hiragana? Is there any context memory, or is each sentence translated as standalone?

Related - this one also works with manga: https://github.com/SethRobinson/UGTLive

I wonder how does it work with multi button multi menu games like Pro Yakyū Spirits

> Inplace overlay on Wayland only works with fullscreen windows (Wayland's security model prevents knowing window positions).

"Security is more important than usability. In a perfect world, no one would be able to use anything!"

Nice, I wonder how the banner would work for menu or any complex screen that's not a single sentence.

In the past, I've used MORT to play some Japanese MMO game. In-place overlay makes it easier to actually play the game instead of doing dictionary lookup on the side.

These days I stopped using realtime translator and just embrace the slow pace of learning these languages while enjoying the game story.

MORT: https://github.com/killkimno/MORT

Nice! I wrote a script similar to this that triggers when I take a screenshot with Flameshot, OCR's the screenshot using an API and opens web page with the OCR'd text. I prefer to use a Japanese to Japanese dictionary when possible which I have as a browser extension (yomitan). I like that this approach doesn't require an external API.

Not techy at all, may I ask how to run it on windows 10/11?

Awesome stuff. +100 cool points for using a local model

Very very cool!

I imagine this is more for turn based games though.

Need one but for Chinese!