Yeah, I get where you're coming from. Just be careful on getting too defensive about flags, that can bring more attacks on you. Actually, I think you'll find that you will get some upvotes on these comments once people understand what your real intention was.
There is a common misconception that a downvote/flag is an "attack:" It is not. It's just the opposite of an upvote. Do we ask "Why am I getting attacked by all these upvotes?!?"
However, I do agree that it's common courtesy to leave a comment stating the reason for a flag, though many people don't. If you feel like it, you can always update your original comment as you learn more about the situation. Some of the flags might get removed depending on how much your understanding grows.