Researchers at the University of Pennsylvania are working on a groundbreaking technology that could provide robots and autonomous vehicles with what can only be described as ‘superhuman’ vision. By harnessing the power of radio waves, these robots may soon be able to see through smoke, intense rain, and even around corners, paving the way for advanced applications in search-and-rescue missions and security operations.
The journey to this innovation, however, has not been without its challenges. A University of Pennsylvania student conducting a late-night experiment encountered an unexpected issue when testing the robot’s ability to see through smoke. As soon as the student activated the smoke machine, a loud fire alarm blared throughout the building, prompting an immediate response from security personnel.
“The whole building got triggered,” recalls Professor Mingmin Zhao, who leads the research team. “My student called me, very surprised.”
Despite this minor setback, the team has continued refining the project, developing a robot with a spinning array that emits radio waves in all directions. The onboard artificial intelligence (AI) system then constructs a 3D representation of the surrounding environment based on the reflections of these waves.
A new approach to Robot vision
Traditional robots and autonomous vehicles rely on optical cameras, light detection and ranging (Lidar), and infrared sensors to navigate their environments. However, these systems often struggle in conditions with low visibility, such as dense smoke or heavy rain. The solution proposed by Professor Zhao’s team bypasses these limitations by leveraging radio waves, which can penetrate such obstructions and provide a clearer picture of the surroundings.
While radar technology has long been used for tracking aircraft, ships, and weather patterns, this new application represents a significant advancement. The ability to see through smoke could prove invaluable in life-threatening scenarios, such as firefighting operations where search-and-rescue robots need to locate trapped individuals.
“Our goal is to help robots obtain superhuman vision – to see in scenarios where human eyes or traditional visual sensors cannot,” explains Professor Zhao.
To prevent future fire alarm mishaps, the researchers devised an alternative testing method by enclosing the robot’s spinning equipment within a clear plastic box filled with smoke. This allowed them to observe the system’s effectiveness without setting off alarms.
How radio waves enable vision beyond human capabilities
Although invisible to the human eye, radio waves are a form of light and belong to the electromagnetic spectrum, which also includes X-rays and gamma rays. Unlike visible light, which is easily obstructed by small particles such as smoke, radio waves have much longer wavelengths, allowing them to pass through obstacles that would typically obscure vision.
By designing the robot to detect radio wave reflections, the team has enabled it to ‘see’ beyond what is possible with conventional imaging techniques. This capability has profound implications for various industries, from emergency response to defence and security.
In addition to seeing through smoke, the system can partially detect objects around corners. Professor Zhao likens this to a “hall of mirrors” effect, where radio waves bounce off surfaces, providing indirect visibility into obscured spaces.
Broader applications and future prospects
Experts in the field are optimistic about the potential of this technology. Professor Friedemann Reinhard from the University of Rostock in Germany, who has previously studied how Wi-Fi signals can be used to visualise rooms, praises the research as “very interesting and quite impressive.”
One challenge, however, is that the spinning radio wave array does not provide an instantaneous 360-degree view. The data collected requires significant processing to generate a clear image. Yet, the team’s use of millimetre-wave radio frequencies—similar to those employed in 5G networks—suggests a cost-effective and scalable solution.
“That’s potentially very attractive; it’s a well-understood, inexpensive technology,” says Professor Reinhard. “I would love to see a self-driving car operating purely on radar.”
Alternative approaches to radio-based vision are also being explored. Fabio da Silva, founder and CEO of US-based Wavsens, has developed an algorithm that eliminates the need for a spinning device. Instead, it continuously senses the entire space in real time, much like the echolocation used by bats.
In the security sector, radio wave technology has already been tested for detecting concealed weapons such as knives and handguns. Some scientists have even proposed using this method to monitor nuclear stockpiles, allowing governments to track the movement of warheads without physical inspections.
More Read
Emerging technologies and ethical considerations
While the ability to see through obstacles holds great promise for rescue missions and security, it also raises concerns regarding privacy and potential military applications. Police forces and defence agencies are exploring the use of radio-based sensors to see through walls and doors, a capability that could be used in counterterrorism operations but also poses ethical dilemmas.
“We created a system that allows you to detect everything in a room, even if it’s behind a wall,” says da Silva. “It’s a game-changer for security applications.”
At Loughborough University, Dr Luana Olivieri is investigating another form of non-visible electromagnetic radiation known as terahertz waves. These waves, which fall between radio and visible light on the spectrum, have the potential to identify substances by detecting their unique chemical signatures. Such a system could, for instance, identify illicit drugs or hazardous materials from a distance.
While there are significant benefits to these advancements, concerns about misuse persist. Professor Reinhard points out that while radar-based technology might seem invasive, the real risks to privacy come from cheaper and more widespread surveillance methods, such as drones and high-resolution cameras.
“Maybe radar sounds scary – but drones and cheap cameras are much more dangerous,” he warns.
As the research progresses, the challenge will be to balance technological innovation with ethical responsibility, ensuring that these ‘superhuman’ vision systems are used for the benefit of society rather than for harmful purposes.
