I think best thing you can do is just ignore them.
There will always be people who downvote just like dislikes on youtube...