Gonna shed my lurker status just this once to give something back for AMD linux users.
Now that Arch finally gained ROCm support and my 6700 XT is semi supported I will share my scripts to create a "small" fairseq appimage with pytorch ROCm. It's relatively simple and straight forward so just go read the README and read/execute "recreate_fairseq" in the same directory as the folder "Sugoi-Translator-Toolkit-V4.0-Public".
Install instructions and requirements are in the README.
You must be registered to see the links
Some things to note:
Many consumer GPUs need to pretend to be another one to work, just like my 6700 XT.
That is done by exporting HSA_OVERRIDE_GFX_VERSION=10.3.0. "10.3.0" means I'm pretending to be gfx1030 aka 6700 which is supported in rocm.
"rocminfo | grep gfx" shows you what you have or are pretending to be, even if they are not working. Researching this is a pain in the ass so you are on your own.
This would also be a good starting point if you want to hack your own ctranslate2 native build or just the normal one.