There might not be zero music, but anything that had questionable licensing is being ripped out for the Steam release. The only differences that I know of for the Itch/Patreon vs Steam release is the said removal of (some/most/all?) music in the Steam version and the addition of achievements in the Steam version. I do not believe that the final final that hit Itch has had an achievement screen added. So, if you're an achievement hunter, it's possible that Steam is your only option.