It depends, others opinion about you do not matter at all, in one way. Quite often, other peoples opinion about other people, are a reflection of their own beliefs, and thus, their opinion about you, tells you more about them, then it does about you.

However, getting useful feedback from people, is worth listening to, because it can help you see other peoples perceptions of you.