The Natural Horsemanship trainer who trains out of the barn takes in a lot of problem horses. There are FAR more difficult horses on the property than mine. My horse has been blanketed his whole life. He’s very sensitive under saddle and processing new information. He’s pretty great with routine and in his pasture. He’s easy to blanket if blanked correctly and with someone who understands body language, as the BO told me.
My horse has never been difficult on the ground here because he had extensive training in groundwork with the NH guy. I can longe him in the arena without a halter, free-jump him without a halter and a chute but just with one jump in the arena, and lead him by his withers. I let him graze without a halter (this time of year, he has no green grass in his pasture) and return him to his pasture by leading him by the withers.
Can you do any of this with your horse? You really are assuming a lot in your posts.