As far as I am aware, for a male (assuming you are because the rules for women are pretty different and most do not traditionally apply), removing a hat is a sign of respect.
Grew up in the American South where historical customs like this are just a way of life.