The grub who kept down-voting me had much more SP than I do. Post comments on every single one of his posts. When he down-votes the comment to make it disappear, come back and post again. Trust me, be relentless and the moron will get the message.
Force the retard to keep down-voting you. Eventually you will totally destroy their voting power and they won't harass you ever again.