Tool Sugoi - a translate tool with offline AI-powered model to translate from Japanese; DeePL competitor

N

NoZeR17

Member
Sep 7, 2020
211
60
79
yo, wanted to download sugoi-web here which is here >
You must be registered to see the links
.
But i just can't. I downloaded latest version + did everything based on instruction but but...
1. the chrome doesn't see json files, i dunno what to do (passed it somehow but not sure that i did it correctly)
2.even if i somehow install "sugoi web translation" > it tells me there's a mistate ( again passed somehow)
3. the next step > Open {Sugoi folder} / backendServer / >> I DON'T HAVE SUCH FILES, lol
Emm... recommendations? maybe i missed smth and need to download smth else, dunno, just wanted to read some novels on syosetu
 
N

NoZeR17

Member
Sep 7, 2020
211
60
79
do somebody know, sugoi toolkit is going to expand number of supported languages? cause download sugoi toolkit, then some ai studio, then that gguf thing only to understand that ur language's not supported was funny
 
Entai2965

Entai2965

Member
Jan 12, 2020
173
517
170
NoZeR17 said:
do somebody know, sugoi toolkit is going to expand number of supported languages? cause download sugoi toolkit, then some ai studio, then that gguf thing only to understand that ur language's not supported was funny
Click to expand...
Sugoi only does JPN->ENG. If you want to use other languages with the toolkit, try this.
 
  • Like
Reactions: NoZeR17
N

NoZeR17

Member
Sep 7, 2020
211
60
79
Entai2965 said:
Sugoi only does JPN->ENG. If you want to use other languages with the toolkit, try this.
Click to expand...
well, i've checked it out. Unfortunately, it is said that it is "comparible" to google translation, then why i should do 100 extra steps if i can use google translation, lol. Thanks for ur answer, tho, i've seen dozens of languages in python code while was installing llm so i though that it can be translated not only to english, well whatever
 
Last edited:
N

nekim

Member
Sep 16, 2017
250
445
249
Last edited:
  • Like
  • Yay, update!
Reactions: Pkd76L, hilih--, rav4nger and 4 others
tupdomain

tupdomain

Newbie
Apr 18, 2018
24
6
34
does anyone know the minimum spec for running sugoi LLM? my laptop only has rtx350 with 4 gb vram, 16 gb ram, and I5 11400H (acer nitro 5) which i feel inadequate for running llm locally
 
N

nekim

Member
Sep 16, 2017
250
445
249
tupdomain said:
does anyone know the minimum spec for running sugoi LLM? my laptop only has rtx350 with 4 gb vram, 16 gb ram, and I5 11400H (acer nitro 5) which i feel inadequate for running llm locally
Click to expand...
for the best (fastest) performance you need a gpu with 12 GB vram. (fully loading model to vram)
you can use system ram with partially loading LLM to vram but CPU core speed and number of cores will be important.
you can use LLM on your laptop but you will be needing to do try different settings for partially loading LLM to vram etc.
 
  • Like
Reactions: tupdomain
R

RottenBoner

Newbie
Nov 28, 2017
75
71
138
Entai2965 said:
View attachment 4260711

Does anyone want to help me out as a beta tester for a multi-language Sugoi compatible server?

0. If you are already using a Sugoi-Repackage, then skip to step 5.
1.
You must be registered to see the links
. I recommend the Sugoi-Repackage-CPU since it is the smallest after installation
2. Extract it
3. Double click on Sugoi-Repackage.reproducible.bat
4. Wait for it to install
5. create a new text file where Sugoi-Repackage.reproducible.bat used to be called "Sugoi-Repackage\Sugoi-Repackage.multilingual.update.cmd" It needs to be in the same folder as the translationserver.ctranslate2.bat file that appears after the repackage is set up so that apps\ is a subfolder.
6. Copy the text from the following spoiler into that file
You don't have permission to view the spoiler content. Log in or register now.
7. save that file
8. double click on it and wait for it to update the server
9. it should create a file called multilingual_sugoi_compatible_server_ctranslate2.cmd, double click on it
10. test with sugoi somehow
- Launch Sugoi Toolkit's offline translator and copy japanese text to the clipboard
- visit the streamlit ui at
You must be registered to see the links
and type in some japanese text, then hit the translate button
-
You must be registered to see the links
's Sugoi addon (that was originally for Textractor)
- Launch T++/SLR Translator and translate something using Sugoi Translator
11. Once it is working, close the two cmd_exe windows that popped up.
12. Open multilingual_sugoi_compatible_server_ctranslate2.cmd with Notepad++ and update the target language.
13. Double click on multilingual_sugoi_compatible_server_ctranslate2.cmd again
14. Test sugoi again with any of the ways described in step 10 above, and that should produce multilingual output

Once multilingual output is working, close the server again and update the model to a bigger one to improve the quality. small100 is the default model used in the script because it is very small, and there is no point downloading anything larger unless you can get it working. It is about the size of Sugoi. But once you have it working, the larger models (m2m100, nllb-200) 2-12 GB in size and 2-13 GB of memory during use all produce better translations than small100.

There is a way to update the languages without relaunching the model now, but none of the Sugoi compatible software can do that yet until people update their software to support it. Here is some
You must be registered to see the links
for the temporary server. The answer to any question you may have is probably in there somewhere.

And finally, please describe your experience using the server, the stuff you think could be better, and ask additional questions not answered by the documentation.
Click to expand...
Lo probe, funciona, pero medio mal, siempre pone "ate" y la traduccion cortada, que calculo que debe agarrar la palabra translate del codigo
 
Entai2965

Entai2965

Member
Jan 12, 2020
173
517
170
RottenBoner said:
Lo probe, funciona, pero medio mal, siempre pone "ate" y la traduccion cortada, que calculo que debe agarrar la palabra translate del codigo
Click to expand...
Thanks for trying it out!

Use a larger model though. The default one is small100 which is extremely poor quality. It uses that one by default because it is small. There is no point in trying a larger one if the software does not work at all. Now that you have it working, try the larger modes. Here are the
You must be registered to see the links
. The syntax is like...

Code: 
python multilingual_sugoi_compatible_server_ctranslate2.py --list
python multilingual_sugoi_compatible_server_ctranslate2.py --model_name nllb-200-distilled-1.3B-ctranslate2
 
  • Like
Reactions: RottenBoner
R

RottenBoner

Newbie
Nov 28, 2017
75
71
138
Entai2965 said:
Thanks for trying it out!

Use a larger model though. The default one is small100 which is extremely poor quality. It uses that one by default because it is small. There is no point in trying a larger one if the software does not work at all. Now that you have it working, try the larger modes. Here are the
You must be registered to see the links
. The syntax is like...

Code: 
python multilingual_sugoi_compatible_server_ctranslate2.py --list
python multilingual_sugoi_compatible_server_ctranslate2.py --model_name nllb-200-distilled-1.3B-ctranslate2
Click to expand...
Same thing sadly, and kinda worst though, it translate and display multiple times the same sentence, and add the previous translation to every new sentence, making it way more slow, and it appears poorly written on sugoi, sometimes instead of translation, appears "!(ja" and the exact line that it's in the game without translating at all. Maybe is my potato pc messing with it, but for now, i will not use it again. Thanks anyway! Maybe someone who speaks spanish will have more luck with it than i do
 
Entai2965

Entai2965

Member
Jan 12, 2020
173
517
170
RottenBoner said:
sometimes instead of translation, appears "!(ja" and the exact line that it's in the game without translating at all.
Click to expand...
Are you sure you are using the correct language code? The different models use different language code formats. Which model are you using exactly? for the nllb models, you may need to add
Code: 
--source_language jpn_Jpan --target_language spa_Latn
small100 language codes -
You must be registered to see the links

m2m100 language codes -
You must be registered to see the links

nllb-200 model language codes -
You must be registered to see the links
 
R

RottenBoner

Newbie
Nov 28, 2017
75
71
138
Entai2965 said:
Are you sure you are using the correct language code? The different models use different language code formats. Which model are you using exactly? for the nllb models, you may need to add
Code: 
--source_language jpn_Jpan --target_language spa_Latn
small100 language codes -
You must be registered to see the links

m2m100 language codes -
You must be registered to see the links

nllb-200 model language codes -
You must be registered to see the links
Click to expand...
I was using the llb-200-distilled-1.3B you put in the comment above. I applied the correction on the code that you said, and now works way better, some words are in misorder, and others are ignored completaly in translation, but it's understandable. Again, maybe is my potato pc doing what she can, but I will try a bigger model, thanks for the correction!
 
  • Like
Reactions: Entai2965
O

olafie0304

New Member
May 16, 2024
2
0
87
I'm new to all this. What does the Sugoi Translator LLM do? Do I have to install LM Studio or Ollama for it to work? Or is it a standalone inside Sugoi Toolkit using models downloaded from huggingface? Sorry for this beginners question.
 
ChaosXD

ChaosXD

Member
May 21, 2017
320
145
213
olafie0304 said:
I'm new to all this. What does the Sugoi Translator LLM do? Do I have to install LM Studio or Ollama for it to work? Or is it a standalone inside Sugoi Toolkit using models downloaded from huggingface? Sorry for this beginners question.
Click to expand...
I think it lets you use an llm for translation instead of the sugoi offline model. You need to either host it yourself (lm studio or ollama) or provide a api to use with chatgpt or another online model. (I am not sure, never used it, please correct me if I am wrong)
 
iliketestes

iliketestes

Active Member
Mar 17, 2019
598
762
281
havent used this in a while. whats the point of sugoi 12.5 if the 14b LLM verison is now public (for visual novel translation i mean)? do we use the toolkit to link with the LLM so it can display the translation based on the sugoi UI we've been using since the beginning? (the blue box)
 
G

Gecy

Newbie
Apr 30, 2020
88
121
197
It's not the right place to ask, but still, did anyone try "
You must be registered to see the links
"?
 
You must log in or register to reply here.
Top Bottom