I agree that we need some kind of down vote system in place, Because up voting shouldn't be the only option. Then we can save the Flag button, for spam or other extremely harmful content. The downvote button would give us the opportunity to make decisions on how much the author "deserves" to make.

Exactly. We should be able to downvote something that we consider to be of positive value if we believe that value to be less than the estimated payout. And we should be rewarded for correctly downvoting content with inflated rewards.