Just carry a hat. Toss it in a saddlebag, sit on it, stick it in your jacket, strap it to the handlebar - whatever works on your bike.
I used to ALWAYS carry a cap cause my hair looked stupid when the helmet came off. Now I wear it very short plus I don't care as much. It's called getting older - who really cares.