When I first read this I though you wrote 'smite' them (instead of smile) and thought, hmm, not a bad suggestion! =-)
But yes, knowing your limits (setting boundaries?) isn't selfish at all.