Reed, of course obey your doctor.
The last two times I fell off (at a walk) it was down into deep sand. Both times when I asked the doctors how long until I could ride again they told me 6 weeks, and would not budge on that in spite of my moans and yells of anguish (I wanted to get back into the saddle!).
The first time I was wearing a safety vest–2 broken ribs.
The second time I fell right on my left hip joint. I had a lot of pain but amazingly I did not break my hip (proven on X-rays). My ribs hurt like the dickens but I did not even crack a rib. I still HURT a whole bunch.
After 6 weeks I had to rebuild my muscle strength. I NEEDED help both mounting and dismounting.
A little hint, after the first time I could not dismount from the 18.2 hand horse I finally figured out if a person on the ground pressed my knee joint into the saddle I could dismount fine. It took a few months before I stopped needing this help after my falls.