Most people I speak with cannot wrap their minds around the idea of not having government for some reason, though they seem to be able to get up and go about their day just fine pretty much every day (excepting those where run afoul of their rulers).
Leaders vs Rulers
For some reason cough public schools and media cough, most people confuse rulers and leaders.
A peaceful society can have as many leaders as there are people, simply because different people are better than others at different things.
Simply replace rulers with leaders and you would have a different world. The difference being that a leader has no perceived right to force others to do anything.