Imo, it is bad for a sex game highly focused on the choose-your-own element, since the sex is a huge part of the point. It'll be less noticeable depending on what your path preferences are, which is likely why it doesn't bother you (to ffive specifically). But the point of design in the end is to increase enjoyment. I can absolutely see Charisma, Charm, Athletics serve their purpose for the other elements. But in the end, I see those things as there to add necessary immersion in what is, after all, a sex AVN where you want to get the character & personality you've formed into certain sexual situations. When those sexual situations are present already, on your specific path, and only grayed out because you don't imagine your character would say "I'd like to stick my hole-in-one, yuk yuk" while playing golf, I just find that silly and poorly thought out, really. Not serving much purpose.
These are more my thoughts on design in general & what the end goal is. An AVN, especially in respect to the "A", is quite different than a platformer.
Other part is, I don't believe it reflects real life very well at all either.