No, if the story has to going to their homes or have progressed into their stories where you can go to their houses daily then it's a matter of it being the correct time of the day, depending on who it is it would generally be 13:00-20:50,15:00-20:50 or 21:00-03:50.
I am working on a fully detailed strategy guide including all the info not given to you from
Book of Faces including character details, how do I..., where do I..., extra details like all side quests infos and secrets but until then check out
Jieigh's post for the times:
https://f95zone.to/threads/my-new-life-revamp-v-0-83-alpha-version-beggar-of-net.30576/post-5055020