In World of Warcraft or in the gaming world it's called griefing. The purpose of griefing is to take the sense of win from someone else. We already know from the gaming community that this is the behavior of a griefer and griefing has a negative effect on the overall funness of the game.
Downvoting for reasons not outlined in some sort of manifesto, rules or personal criteria, is possibly just griefing. When it's justified then at least people have to break some rules first.
References