So, in this post I will rant about my grievances with ChatGPT while translating this game.
As you all know, LLM based systems can somewhat understand context and provide much better results compared to standard translation softwares.
So, after getting the chance to use GPT-4 for a few days, I suddenly had the bright idea to use it to translate a random game.
I just needed to extract the text in a format ChatGPT could accept and fix any mistakes I saw in the output.
Simple, right?
WRONG!
It's not simple at all!
Why?
For a few reasons:
1 -> AI "Moral" Lock.
What does this mean?
In simple terms, all of these LLM-based chatbots come with certain limitations imposed by their developers. They will refuse any input that includes violence, harassment, indecency, etc.
This means they simply won't translate adult works because they are designed not to.
You can somewhat convince GPT-based chatbots, but LaMDA and Claude will refuse to have anything to do with this.
And even if you have convinced GPT to translate the text for you, it can still refuse your next input.
As if that wasn't bad enough, it can sometimes stop in the middle of the text and refuse to translate the remaining portion.
2 -> Text Format.
As I mentioned earlier, you need to extract the text from the game in a format ChatGPT can accept.
But sometimes ChatGPT will remove the symbols used to indicate scripts or special characters within the text.
It's still manageable when it decides to remove all of them; you can easily notice the problem and fix it.
But sometimes it will remove just one crucial symbol, and you'll have many problems if you don't notice.
3 -> AI Hallucination.
My last and biggest problem with this whole process.
AI fucking HALLUCINATES!!!
What does this mean?
Simply put, let's say you have a short story.
In this story, two old friends coincidentally meet after years and decide to enter a restaurant to sit and talk. One of them mentions how good this place does steaks, then mentions they even have alcohol. They talk for a few hours in the restaurant, exchange their new contact numbers, and part ways.
Now, you have translated this text to another language using AI.
In the translated story, two old friends coincidentally meet after years and decide to enter a restaurant to sit and talk. One of them mentions how good this place does steaks, then continues to explain that the secret of this taste is a well-protected secret of the restaurant. Then he mentions some theories about the restaurant's special recipe. They talk for a while, and the other friend decides to go on a long journey to rediscover himself.
Do you see what I mean?
If you don't know some Japanese or don't use another tool to check the translation, you can present your players with an entirely different story. I have some basic (very basic) level Japanese, which wasn't enough to discover this problem, and I had to completely discard a lot of effort.
I then learned my lesson and used several different tools simultaneously to catch and fix these hallucinations.
In the end, I think I did a decent job with this game. But I refuse to do this whole thing again until AI research progresses significantly more.
