If you are in the mood for casual seafood, I’d highly suggest The Regatta, located on Nicholasville Road in Lexington Green (go through Joseph-Beth bookstore). Its GREAT food. My parents drag me there everytime they come to visit me (and as a poor college kid, I do NOT mind!). Also Myako on Richmond Road is a very good hibachi grill if you’re in the mood for that.
I also agree with Dudley’s, DeSha’s (but parking might be difficult), and like Viney said, I HIGHLY recommend waking up early for breakfast at Keeneland!