Sort:  

But if they were "worthless" down-votes, I do not see why it would matter? Unless of course, I am misunderstanding something.

Even the low-rep downvote bots can still affect your payouts. Generally not much, but sometimes quite a bit.