Right now the mines are just super not worth doing. If golems aren't going to be capturable, they should drop more ore than just a single one to help make the mine a better value proposition. As it stands, once you get tier 2 armor, mining is "free" (in that you take no damage) and bandit encampment is... basically free (only 5 damage per attack from male bandit), but the bandit camp fights go faster and are worth a lot more. While in the mine you could get lucky and get a bunch of ore without any fights, the ore itself is still not really valuable enough to make this worth it (not even taking into account slime girls in the bandit camp, who drop free healing items making the camp even *more* valuable).
Edit: suggested fixes
ore is worth 90 g, not 80
Golem drops 2-3 ore, not 1
pickaxe has better damage than unarmed, worse than first tier sword (helps speed up fights in the mine to make it a better value per time proposition)