If you agree with them it stuffs up their prepared escalations, cuts the ground out from under their feet and leaves them nowhere to go.
Sometimes they might even have a semblance of truth in their accusations as well.
Also, remember when you are pointing one finger at somebody, there are three more fingers pointing back at you. [as in the proof picture]