I am waiting for the "talks with aliens" shows.
And the moment that they bring up, why didn't you talk to govern-cement. You know, "take us to your leader" ?
And that opens up that they do not deal with psychopaths.
I know of the anarchist views that lead to your statements, and know how that logic goes. However, they have to assume all people can defend themselves, that all people can be equal under the law, and that all people are capable of doing right. (or being self governing) And this is wrong, and doesn't really exist.
The group does exist. And the group does do things. It is an energy structure as well, that doesn't exist in each person separately.
So, it has to be worked with, and given legal standing, or defined.
And that group will do things, like expel a used-to-be-member. Sometimes by a vote of every group member who is capable at the time. Or by a single entity that "speaks" for the group.
These things really need to be worked on. Legally speaking. Or in some way that makes it easy to discuss.