There are actually some apps that do a pretty damn okay job at that already...They're getting better very rapidly...
It honestly wouldn't surprise me if you could get almost real time translation through an ear bud from your phone or other device within the next decade at the rate we're moving...
Assuming society doesn't implode before then...lol