Everyone gets flagged if they comment on his posts, not just you. So don't feel it is due to your comments. There are bots attacking his followers. When it gets bad he will post a comment that you can post under to avoid getting down voted.
Unless you are being flagged by him or down voted by him, then that's completely different.