Tool RPGM DazedMTLTool - A tool that provides quality MTL translations using ChatGPT

dazedanon

Engaged Member
Modder
Uploader
Donor
Jul 24, 2017
2,189
21,373
Nice tool and effort, keep going, don't get me wrong, but "quality" - nah i don't think so while played your latest translation project. As said before... no consistency in the translation. Not patreon worthy for me, sorry.
That's fair it's not for everybody, it's still a machine so maintaining consistency for everything is unlikely.
 

Spermasahne

Member
Apr 7, 2021
408
831
You could just search "I obtained" and replace it with "Obtained" in every json file, like TL++ does, maybe? :)
But keep going!
 

dazedanon

Engaged Member
Modder
Uploader
Donor
Jul 24, 2017
2,189
21,373
You could just search "I obtained" and replace it with "Obtained" in every json file, like TL++ does, maybe? :)
But keep going!
Done and pushed to the patch, really that's all you have to report to me. I generally ignore stuff like that unless someone reports it since it doesn't bother me at all.
 

Spermasahne

Member
Apr 7, 2021
408
831
Done and pushed to the patch, really that's all you have to report to me. I generally ignore stuff like that unless someone reports it since it doesn't bother me at all.
Understandable, some people just prefer some kind of consistency i guess and i thought maybe it would improve your so far good translation a little bit or appeal more to users like me that are just stucked to their consistency xD Thank you very much.
 
  • Like
Reactions: dazedanon

Jinnai

Noodlz.
Donor
Jun 26, 2018
120
329
Can you explain to me what part of this process is tied to a cost/fee, like I'm a 5yo?
I have no clue about any of this, but I find it very interesting!
 
  • Like
Reactions: doarcutine

dazedanon

Engaged Member
Modder
Uploader
Donor
Jul 24, 2017
2,189
21,373
Can you explain to me what part of this process is tied to a cost/fee, like I'm a 5yo?
I have no clue about any of this, but I find it very interesting!
Like how the estimator works? Sure.

It basically does exactly what the tool does when it's translating. It scans for a code, text, or whatever. Grabs it like normal, but instead of translating the text, it run it through a library (Created by OpenAI) that calculates the number of tokens in the text.

I take that, do the math according to the API cost, then total it all up. Then it spits out the total estimated cost and the cost of every file it scanned. Still not perfect but I find it's around 95% of the way there.

but you generally use GPT3.5, am i right?
Yup, I've been using 4 some too as well. I think Bard uses Palm2 API for their devs and currently its in closed beta with rate limiting so I actually can't test it even if I wanted to. Once their pricing comes out if it's comparable to 3.5 I think I might take it for a spin.
 

xeratzy

Member
Apr 2, 2018
128
79
Took a look at the open.ai plans for fun, is the "3.5 Boost Model" on frontpage post referring to "GPT-3.5 Turbo"? or is it something else completely?
 

salaciane

Newbie
Apr 2, 2023
28
44
Might wanna take a look at Falcon 40B, or Falcon 7B... tbh I don't think 7B is up to the task, but 40B might be good enough, since it's open-source and you can run it locally (if you have the perfs for it), you won't need to deal with API filters if they ever become a problem, plus you won't be violating the liscence... which we are on a piracy website so I dunno how relevant that is


But the most important plus is that you could do some reinforcement training on the model to make it better at doing the translation, and can have more control over what the model outputs... there are plenty of already translated games, so maybe taking the original and translated version of those as training data could be a good idea to make it more suited to this work...

and it would be free.... well appart from the computer needed to run it, though I bet you can rent one online...


Edit: 40B needs 100GB of Ram... but 7B only needs 16... maybe with some reinforcement training it could work

Links:
Falcon 40B:
Falcon 7B:
 

dazedanon

Engaged Member
Modder
Uploader
Donor
Jul 24, 2017
2,189
21,373
Might wanna take a look at Falcon 40B, or Falcon 7B... tbh I don't think 7B is up to the task, but 40B might be good enough, since it's open-source and you can run it locally (if you have the perfs for it), you won't need to deal with API filters if they ever become a problem, plus you won't be violating the liscence... which we are on a piracy website so I dunno how relevant that is


But the most important plus is that you could do some reinforcement training on the model to make it better at doing the translation, and can have more control over what the model outputs... there are plenty of already translated games, so maybe taking the original and translated version of those as training data could be a good idea to make it more suited to this work...

and it would be free.... well appart from the computer needed to run it, though I bet you can rent one online...


Edit: 40B needs 100GB of Ram... but 7B only needs 16... maybe with some reinforcement training it could work
I'm actually waiting for the community to come to a consensus on a model that is at least on par with GPT4. I've tried a lot of these models and all of them while good at natural English fail miserably at Japanese translation. Likely because they aren't trained on it. For example.

1689716628852.png

Falcon40b isn't trained on Japanese so I would not expect it to perform very well for translation. It takes time to check all these models individually so I prefer to just wait and see until something outstanding comes along. I'm not too versed in machine learning and honestly not super interested since its its own field. I'm just here to focus on the machine translation aspect and improving that as much as possible.
 

salaciane

Newbie
Apr 2, 2023
28
44
I'm actually waiting for the community to come to a consensus on a model that is at least on par with GPT4. I've tried a lot of these models and all of them while good at natural English fail miserably at Japanese translation. Likely because they aren't trained on it. For example.

View attachment 2781548

Falcon40b isn't trained on Japanese so I would not expect it to perform very well for translation. It takes time to check all these models individually so I prefer to just wait and see until something outstanding comes along. I'm not too versed in machine learning and honestly not super interested since its its own field. I'm just here to focus on the machine translation aspect and improving that as much as possible.
Ah yeah, hadn't noticed the bit about it not being trained on Japanese... Well hopefully in the next few months we'll get something, GPT3 is not that old and we've come far since it came out... so with the speed at which progress is being made, I wouldn't be surprised if within the year we'll get a good option
 
  • Red Heart
Reactions: dazedanon