I guess it depends on who you are, I've never felt isolated even in crazy places. I'm European but even in China where the people are a different race, I'm feeling all right.
I know that a long time ago, I was in a foreign country, but I met other travelers from my native land, and I suddenly found myself surrounded by fellow countrymen, and I didn't like it. If you choose to travel, or immigrate, leaving your country and your friends is very often a motivation.
Nowadays, I'm feeling isolated when I'm going back to my native country, because of the people I see don't have all the experiences I've been through.