I don't see them being different. You could easily put story encounters inside adventure mode without anybody noticing.Quick question: what mode do you think is best, story mode or the other mode?
For example, there's a whole scenario with Kylira and Hiro meeting at inn in story mode. What if there was a certain new inn in adventure, in second location for example, where you could meet Kylira if previously you suggested them to be a healer (currently this option does nothing)? You would get this interaction as if you're both travel independently in plot. Same with finding Kylira and Brigand getting naughty.
Or imagine meeting the Catgirl from story mode at the final location in adventure. She would tell you about prophecy right before you meet Demon King, which makes sense. She would also be more aggressive with hitting on you, which also makes sense as it's final location.
Imagine bandit village and sperm bank are locations on the second and third locations of adventure. It's even more interesting this way, if you think about it. There is no problem with fitting them at all.