Definitely, something is needed to control nasty things but those who are having downvoting power, shouldn't abuse the power also. Before taking any impulsive decision, the powerful person or whale should observe that particular account and if there is really problem then action should be taken. And surely with proper explanation why downvoted.