Agreed. I think the use of condom is an attempt to maintain control over the situation, that the "games" are just games but no one wants any permanent consequences (like babies or diseases).
The decision/change to not use condoms means that the parties have let go of any control, that any and all potential consequences are "worth it." Even if the woman is using some form of non-condom birth control (pills, shots, etc.), there is still a hint of "danger" introduced.
It's significant, IMO. At least in what it represents, even if the actual, realistic risk is only very slightly greater.