It's definitely a difficult thing to deal with. Once you've managed to free your own mind, looking back at where you came from will also involve seeing a lot of people who just aren't ready to follow that path themselves. To quote Morpheus:

"But when you're inside, you look around, what do you see? Businessmen, teachers, lawyers, carpenters. The very minds of the people we are trying to save. But until we do, these people are still a part of that system and that makes them our enemy. You have to understand, most of these people are not ready to be unplugged. And many of them are so inured, so hopelessly dependent on the system, that they will fight to protect it."

C'est la vie, I guess.