Replying here to @smooth
I very much agree. The more freely we express ourselves (in this case by votes) the more the system is informed by a wisdom of crowds effect. In fact there is value to just seeing what is controversial, for example in dating sites it has been shown that a high level of disagreement over attractiveness is a better predictor of who gets the most dates than the aggregate score alone.