Tool Google Lens: Real Time Graphical Translation Idea/project/help

tough love

Newbie
Game Developer
Oct 12, 2020
88
159
Excuse me if this is not the right place to post this. I will move it if necessary.

I have been using Google Lens to translate almost anything Japanese lately.
I can say it is the best machine translation yet, it seems to take context into consideration.
I have been using it to translate manga on demand:
You don't have permission to view the spoiler content. Log in or register now.

I have been looking for some months now for a way of using Google Lens live on desktop to translate in real time, so far unsuccessfully. There is no current official way to use Google Lens live on desktop or an API I could make work in this way.

How this could work:
1. Use Blue Stacks on Windows to install the Google Lens app.
2. Use OBS to simulate a Webcam while recording the screen.
3. Change BlueStacks camera to use OBS virtual webcam.
4. Now, Google Lens will have a live feed to translate.


Problem: while BlueStacks claim they support obs virtual webcam they talk about an older plugin that is no longer in development, and they won't identify the new way OBS sets it's virtual webcam.

Solution: Find the right combination of versions to make this work.
THIS IS WHERE I ASK FOR YOUR HELP.


What I have accomplished:
-Translating manga with Google Lens on desktop in a kind of grindy way using this . There should be a similar way on chrome.
-Putting my phone in front of the PC with a stand, I know, kind of stupid, but it kind of works.