Thanks!
I fixed it by adding chmod +x to the Milfylicious.app/Contents/MacOS/Milfylicious folder:
-rwxr-xr-x@ 1 username staff 82752 5 Sep 17:15 Milfylicious
I'm not sure why other file formats are changing permissions but it seems to happen a LOT when using 7-Zip.