Right click on main screen (where all the text is), select Encoding, then Unicode (UTF-8). This only has to be done once ever, but you have to do it in a fresh game before making a character or anything, because it might crash a game in progress. If you do it once, you should be fine forever, even when upgrading to a new version of No Haven.
You also have to click Tools -> Update Text to HTML in the menu bar up top. Unlike the Unicode thing, you do have to do this once every game, but it's also not fussy about when you do it.
If you do these two things, everything should be strictly better than it was with Rags 2.6. At least, it is for me.