Afraid so. Generally speaking, soon as you unlock lust with someone, try to get it to 10, maybe 15? though I don't think there are any 15 lust requiring scenes yet.It appears that I have to replay this with the proper wiki to help me out.
Turns out I wasted too much time getting everybody to like...40 affection when I should've focused on some of their lust.
At least the skip feature is real nice!