That reminds me of a story I heard as a teenager, where I knew someone (male) who liked pink t-shirts. When somebody asked him what would happen if people think he is gay, because of the pink colour, he said: I know who I am. What others think about me is irrelevant.
When your know who you are, what other do around you and think about you doesn't matter anymore.
Ha! It was just this week I was asked if "they make those in men's?" because I was wearing a hot pink shirt to work.
There is an irony though - even if I did care about what others thought of me - would I care what other men thought of me? Are these men dressing to impress other men? ;D