It's interesting to hear about a man's struggles with this. It's very rare you hear about it. It's weird how you always see yourself so differently than others see you.
People tend to surprise you, when you least expect it. Days where I feel I'm at my worst, I'll get a compliment.
Little tip from a female though, confidence is what's most attractive in a man. I cannot stress that enough. Learning to love yourself, however easy it may sound, can be tough sometimes, I know. It's a struggle most of us have from time to time. But again, if you're assertive and confident you might be surprised. Not cocky, someone worthwhile wont fall for that.
Hope that helps and thank you for sharing.