These events are there to spice things up and reward caring about security and taking a personal interest in it. And a reminder to have a 'rainy days' stash, and not just spend it all immediately. Doesn't have to be monetary (because that increases threat!), you can hoard resources, items or even slavegirls at the farm.
You have some tools to avoid the ill effects, too. 100 dirt and some hurt girls tells me you're in chapter 2. Max security there is 16/2 = 8, I think you can expect the MC to have 3-4 strength with a weapon without too much hassle, and the thresholds for success are 12 and 8. So with some focus and reserved AP, all brawls can be completely neutralised. With just max security, you can avoid hurt girls and halve the dirt penalty.
That being said, in higher chapters the threshold will grow
much faster than security, so you do have a point.
There are also other bad high-level events, like the one where a girl can get kidnapped along with 15% of your gold, or the 'siege' that can destroy
expensive furniture. Security is no joke.
And you ain't yet seen the worst of it. In a certain nutso mod, regular
arsonists can lead to a game over already in chapter 1.
