Yeah I think the explanation is the way to go. Hopefully will lead to a change in behaviour if the person specifically knows why they were downvoted.