Funny how we might have been missing the details like you said, coupled with the biological, physical, etc. advantages it has on us, have you tried picturing we humans living in a world without nature?. I feel like it would be an extremely bland world.
I think you are right, and I think it would be absolutely impossible to live without nature :D