I’m confused. You say you have two horses and a pony, but the barn has twenty stalls? How many horses are you planning on housing on this place?
If you’re putting more than 5 horses on this place; I would say you need more, smaller paddocks to allow for small herds and paddock rotation.
The area to the left of the barn needs to be three long narrow paddocks, maybe with stalls opening from the left side of the barn directly onto the paddocks. I’d also want a long narrow paddock reaching from the bottom right of the barn, and a gate to another one that runs close by the house. The big paddock to the upper right needs to be split as well.
If you post the unedited photo, I’ll try to draw it for you.