I wouldn’t worry too much about it. It’s important that your farrier work with the wonky conformation instead of trying to force the hoof into the “ideal” because the the leg is not straight. The hoof needs to reflect the conformation of what is above it rather than conform to perfection. That will keep your horse healthiest in the long run.
I had one horse with a pastern fx and a screw in it who really toed in on that leg. Showed him in the 3’ hunters for years without a problem. But had to keep on top of his feet - can’t let them go too long between trims. My current mare has a clubby right front foot and grows a lot of toe, and although it’s tempting to whack the toe off, it actually balances the straightness at the heel. She REALLY lands on the outside of that foot.
Your horse can lead a long, useful life as long as you are aware of the risk factors presented by the conformation. Unless you are competing at a high level and have your horse in consistent hard work, I don’t see any reason why he won’t hold up for a long time.