Society is simply an aggregate of human beings as well as a common belief system in majority of people's thoughts that devalues the individual or the person who thinks differently.
Society is an imaginary concept, not real.
I do not agree society is imaginary, but I agree that people don't "owe a debt to society" by default or the "concept" as you said.