I'm not sure I see your point. The fact that neither you nor I wouldn't, doesn't detract from the long history of sustained exploitation carried out by those with the means to organise violence.

The problem of government is an interesting problem, but privatisation of violence doesn't solve the problem. It just rearranges it so that instead of an oppressive state you end up with oppressive landlords.