That is exactly why it is so difficult for many to see the reasoning behind the downvote. Because voting seemingly doesn't cost us anything (it actually does*), we easily lose the healthy appreciation for honest work.
* The reason I don't think voting is free, is because we are currently doing, or have either done much of the work to cumulate our own voting power, or invested in it, or both.