I have a horrendous commute, 62 miles each way, 5 days a week so am gone 12 hours each day. Basically my husband is as well. I rarely leave the horses in stalls during the day because of this. The weather has got to be pretty crappy for that to happen. Mine are generally out 24/7 in decent sized pastures; my three draft crosses in a 10 acre pasture and my 4 minis plus a POA and ISH yearling are in a 5 acre pasture. We usually have decent grass during the summer and I keep round bales out in hay huts otherwise.
The 3 big guys have a loafing shed, big oak trees and woods in the back of their pasture. The minis, POA and ISH, have big oak trees and it gets very shady up at the top of their pasture but no loafing shed. They get to come in more because of this if it’s rainy/stormy/cold and wet, or terribly hot, in which case I have fans in the stalls they go in. Because I’m gone so long during the day and because our 17.5 acres sits back off the road so neighbors are highly unlikely to notice anything amiss, I don’t like to keep them confined to stalls when I’m gone. I’ve been doing it this way now for 21 years.
Yes, I’ve come home to a few surprise injuries over the years and a few colics but only 2 were catastrophic (broken shoulder in a yearling colt; intestinal volvulus in a broodmare 3 mos post foaling; and one stupid mare who decided she didn’t like her pasture mate and proceeded to go through virtually every fence on the property - that was at our other property and she went over the one section that had t-posts and caught a leg, the rest was smooth wire. Her injuries were ugly but she eventually healed). Some things are going to happen no matter what, I mean because, they are horses after all and it happens anywhere it seems. Our property is gated, perimeter fenced and lined by woods on three sides, so when we’ve had a jail break, it’s been contained within the property.