Hmm what about 3.05? If 3.06 has translation bugs and 3.04 has actual bugs. Is the 3.05 version the best to play?
I wouldn't bother. The game's not fully patched or human translated yet, you aren't going to get a seamless experience no matter what you do, and downgrading versions while keeping saves is a really bad idea so you'd have to start againfrom a new game or one of the included save files. If you run into something important that's in Japanese, [Unlikely given how the files are arranged,} snap a pic of it and toss it into google image translate or something.