It's not the annoyance factor so much as I don't like to see em rake in big bot votes on their lame posts... When they're spammy in my comments, I just trollolololol them and sometimes it's marginally fun :)