If you want to take it to this extreme... Let's say Ben saw Mises building his home in a valley surrounded by mountains with only one entrance and exit. Ben sneakily builds a wall blocking the path thereby imprisoning Mises in the valley. Can Mises do what it takes to escape? Who is justified in their action if there is no government to resolve this conflict of interests (I think that is the point you are trying to make)?

Either way, someone is going to have to make a decision on the matter. Whether you decide to pay and give control to a coercive government to make the determination, or come up with a mutually beneficial agreement on your own, a decision will be reached regardless.

In this example, if Ben wants to be malicious, then Mises would do whatever it would take to survive. Meanwhile, the rest of the community will be seeing how Ben is treating Mises and would decide how they want to respond to it.

Let's say North Korea somehow was able to imprison South Korea. Would we need to create a world government to resolve it?