Yes, but once you've fully upgraded the farm, that becomes a non-issue. With everything upgraded, the farm can basically defend itself without you being there.If you deny Bailey at Alex's though he just makes Remy stronger
Granted, at this point, the Bailey payment is also pocket change.
The recommendation if you want to be optimal at farm defense and don't care about $4k/month, is to ONLY pay Bailey on the week before the farm assault. Their reinforcements go poof as long as you pay them before the assault.