Yeah for me eventually it seems like your sex cravings increase pretty fast so I don't like the penalty from that with Sex Addict. For me the no brainer disadvantages are Unlucky, Debt, and Haunted. If you take Mountain Man as a benefit then I think Stiffness is another no brainer since you can't train dex to a relevant level anyway, capping it at 70 doesn't really cost you anything.Unlucky, Haunted and imo Debt are free points. I feel like Sex Addict is way too much, you recover sexual appetite fast in this game so you'd always be running around with a debuff.
I think Gluttony might be easy to mantain honestly but I've never taken it.
Personally I like the stim allergy disadvantage as well although that one is definitely painful in the early game. Once you get duraplate, a healing implant, and have a good quartermaster and a few nurses it's not a big deal unless you do multiple back to back battles where MC is taking heavy damage. The only scenario that comes to mind for that is the Rebellion fights but by that time you should have the occult powers anyway which gives you an alternate way to heal.