According to researchers, this makes it possible for robots to precisely navigate through challenging situations and obstructions like smoke, glass, and walls—situations in which conventional sensors are inadequate.

“This innovation in AI-powered perception has the potential to improve multi-modal systems, helping robots operate more effectively in challenging environments like search and rescue missions or autonomous vehicles,” said the team, in a video posted on YouTube.