I was 29 when I started hunting. I just went on a lark, I had grown up showing huntersblah blah blah, got back into horses after college etc, and decided I wanted to try it since it was something I have always wanted to do. Then I caught the fever, joined and the rest is history. I do really wish I had discovered it when I was a kid and my bones were still soft 
Flash forward and I am now on my second generation hunt horse, I hunt with two hunts regularly and have colors with both. I was staff at one for about 6 years, still fill in in various capacities (mostly whipping in) and at the other I am also staff, I am a whipper in.
Hunting is a wonderful sport, great "training’ for both horse and rider, and tons of fun.
Most hunts are very accomodating and helpful to newbies and will keep an eye out for you.
If you are interested , you should contact a hunt in your area and see if they have car followers or something for the first time you go out. Or if you just want to jump in and ride, go with the hilltoppers group til you know what’s going on.
I would highly recommend that if you can at all do it, lease an experienced hunt horse for your first few hunts (again the hunt secretary can help you with that). It will greatly increase your enjoyment if at least one of you knows whats going on, and you can just worry about the hunt and not what your horse is doing. Trust me on this one. I didn’t have that luxury and my first season was a little hairy since I took an OTTB out of the show ring into the hunt field. That mare ended up being a stellar field masters horse and an even better whips horse, she stepped up and did everything I asked her to do, so you never know. The horse I am hunting now is her 5 year old baby. But I learned, read everything I could about hunting, studied up on it and you can too.
Try it you won’t be sorry 
ps as far as the age thing, I turned 40 this summer. We have a couple of folks in our hunt who are in their 70’s and still hunting. They are treasured members of our hunt and treated with a great deal of respect. They usually go in the hilltoppers group these days (they are fieldmasters), but hunting isn’t about trying to impress anyone 