This is why I dont associate myself with ancaps anymore. The ancap philosophy is just a too big tent philosophy and it doesnt even have any clear stances on issues, and it has conflicting positions on some issues. So of course you will have communist and nazi infiltrators trying to steer it in their own direction.

Perhaps the stance should be no initiation of force, and then the racist will then define it as some races are more prominent to crime than others, therefore they have to get rid of to have a voluntary society. Now this is totally flawed, most of those statistics are biased anyway. But they don't realize that by "physical removal" they imply much greater use of force than the victims would have used anyway. Which means that it's the racist that is the real aggressor.

So the only question that really matters is who has the power? And if you give power to a centralized body be that communist or nazi, it will do exactly that same kind of atrocities as we saw in the 20th century, with whatever justification they come up with.

If nobody has power, or the power is very limited and distributed, then we don't have to worry about any systematic agression. It's just that simple.