Context is very important. No one gets upset by the words themselves, it is the meaning they have applied to them and even 'benign' words can have large emotional effects on different people. In my opinion, it is up to the individual to take care of their own emotion responses, not the speaker.