I believe the answer is they will still go back, it just wouldn't be very comfortable.Random thought, but I noticed that MC always has to be in physical contact with the girls when returning to the house from their ether walks- is it ever said what happens to them if he just... doesn't hold them?
The example I can remember is crash landing with naomi in the middle of ocean:
