I agree, this game is completely unplayable in vr. Most of the game is telling the character to go somewhere and watching them stumble slowly while spouting lines at you. Getting anywhere near them pushes them away from you while you try to move your puppet strings body around.This game is already nightmare controls with VR. I couldn't even imagine controlling this game with mouse and keyboard. It's not like 'Captain Hardcore' or anything similar controls and physics wise.
Despite being a VR user, I still feel your pain though.