You didn't specify certain characters. You said nothing happens, that is wrong. Plenty has happened with the ladies. There is also the hint that a big plot twist is on the horizon. Two of his "memories" are actually predicting the future. Both the Iris memory (jerking off in the hospital) and the Kate memory (masturbating in the spa) have happened after he had the headaches. You said "only handjobs, no sex scenes" when we have had a few sex scenes. As for waiting for their relationship to evolve, there has been growth with all three ladies in his family.