Yep, it's been happening to me.

My follower count is not allowed to reach 600.

I even asked people to just temporarily follow me to see if it is indeed occurring. Within minutes of someone following me, I lose 1-2 followers, and this has happened about 20x now in the last week or so, now that I am testing it.

Been at 591-595 followers for 3+ months.