If the map is gray - it usually means fast travel is locked out because the character has to finish a quest/task that requires them to stay in the vicinity. Finish the task started by using traditional entryways/exits, if necessary to change places.
It's a classic and long-standing mechanism that has been used in video games/VNs since the advent of the fast travel map in games.
Also, players should not use the map for fast travel from inside buildings - should always go out the front door of the home, of the school (don't fast travel from the track or smoking area), etc. There are several events that are triggered by the MC entering/exiting entrances. If players use fast travel from inside buildings, they will miss them because the game is not coded to automatically trigger if the MC changes location by fast travel, like some games/VNs are.
You most likely missed something. I have three speedrun video playthroughs for "Season 5":
v0.95.7 main
v0.95.7 netorare (ntr)
v1.07.3 main
To find your problem, you can download/watch them from links found here:
29,177
When you have a gameplay question, search the thread first (see my signature on how to set up search results in F95). 95% of the questions asked have been answered at least once. Make sure to use the exact text of the task, if it is a gameplay question - or at least a few common sense keywords.
If that fails, you can search for a youtube playthrough using the exact wording of the task you are working on. example: use Google to search for
taffy tales "I need to find that book"
View attachment 3988193
Doing that would have given you your answer in minutes, rather than hours (or even days, if at all). Very few people actually answer gameplay questions in this thread. It's me and maybe a couple of others with good answers.
Also, you do know you can skip minigames with the cheat code, right?
If all else fails, ask your question in the thread by including a screenshot with the task list open to show the task you are working on.
Perhaps one day you be alpha.