Had an issue that the background sounds would constantly play audio of cars and crowds, so I am sharing the solution in case anyone else gets the same problem.
Turns out it was tied to the save file, and if you load it while it was saved with certain background sounds saved it will permanently play it. I figured that out by loading old saves and they didn't have the problem. There might be a way to stop it via messing around in game and leaving/entering certain areas, but I could not find it.
Using a random browser tool I edited the RPG Maker save files (RMMZSAVE files) as JSON and looked through it. I found the properties "_bgmOnSave", "_bgsOnSave", and they had the sub-properties of "name":"Town5" and "name":"City". I edited them both to "name":"", re-encoded the file and dropped it back into the save folder, and it solved the issue.