You’d never catch me riding when it’s 27 degrees outside, so I say wear the boots, wear whatever it takes to not freeze to death!
As someone else mentioned, you could use the Hot Hands as well, but even though they’re pretty flat, they might make your regular boots a little tighter than usual.