That's exactly what I was alluding to, smaller users would be shut down by a fraudulent claim, lose their SP, and the only recourse is to hope that some whale or group of users bigger than the bully notice and take action to stop it. The bad actor or actors would also be able to create multitudes of complaint posts.
This system also assumes the bad actor isn't just trying to bring the whole system down.