Chiming in from rural Appalachia. It is not an easy place to live. As George_T_Mule stated above, farming is 24/7 365 days a year, and it usually takes every bit of extra income you have. This is a place where the weather is not your friend and the topography makes even little chores a challenge. Don’t ask yourself, “Can I do it?” but “Will I enjoy doing it?”
In addition, it really is culturally narrow here, not because people are anti-outsiders, but because what it’s really like to live here (rather than what’s on travel brochures) doesn’t appeal to everyone.
It is cold and miserable during the winter (and mountain driving in snow and ice is VERY different from flat or urban driving in the same conditions). It is difficult to make a living, and it appeals to people who have a hard-scrabble mindset more than those who don’t. Pioneers moved here years ago, and for the most part, the only people who stayed are the ones who are wired the same way. Others move here, liking the natural beauty, but they generally don’t stay long. Some breeds of horses thrive here, too, while others don’t. Hardier crossbreds, ponies, drafts… these handle the conditions well, while TBs and warmbloods have a harder time.
If these things sound like a satisfying challenge, then maybe rural Appalachia would be a good fit for you, but if not, there are plenty of other ways to try horse-keeping without the extra headaches.