You're correct; there won't be full 3D models and environments like in traditional 360 3D VR games. However, the experience will be somewhat similar to a VR 180 Porn Video, but in 360. With each render and animation, you can look 360 degrees around with your head and use your VR controllers to navigate menus, choices, etc. If there is some freeroam, for example inside the home, it can be comparable to Google Maps where you can point at an arrow, and it drags you to the next image.
This is just an example of how the potential VR version might be.
I'm attaching an 8K 360 Spherical image for you to test for quality reference. I'm using Oculus 3, and I can display the image in 360 by either downloading it directly or transferring it via USB. Then, open the Media App, select the image, and at the bottom right corner, there is an icon that says 2D. Click on it and select VR 360 (not VR 360 3D). Afterward, press the home button on the right Oculus controller to hide all UI.
Unfortunately, the image could not be uploaded and attached here, probably due to its size since it's a raw PNG file. However, I have made it possible to download it via my new website:
You must be registered to see the links