Most lingerie wearing men choose to do so in the privacy of there own home.
In my own case that's where it started, but I've long since taken to wearing my intimates while in public. Many men wear full satin nighties or chemises with matching panties to bed.