The Artificial Intelligence systems powering driverless cars are trained comprehensively in virtual simulations to prepare the vehicle for nearly every event on the road.
San Francisco: A team of Indian American researchers has developed an innovative model that procedures human inputs to expose Artificial Intelligence (AI) “blind spots” in self-driving cars so that the vehicles can avoid dangerous errors in the real world. The model developed by MIT and Microsoft researchers identifies instances in which autonomous systems have “learned” from training examples that don’t match what’s actually happening in the real world.
Engineers could use this model to increase the safety of AI systems, such as driverless vehicles and autonomous robots. “The model benefits autonomous systems better know what they don’t know,” said first author Ramya Ramakrishnan from Computer Science and Artificial Intelligence Laboratory at MIT.
“Many times, when these systems are deployed, their trained simulations don’t match the real-world setting they could make mistakes, such as getting into accidents. “The idea is to use humans to tie that gap between simulation and the real world, in a safe way, so we can reduce some of those faults,” explained Ramakrishnan.
The AI systems powering driverless cars are trained extensively in virtual simulations to prepare the vehicle for nearly every event on the road. But sometimes the car makes an unexpected error in the real world because an event occurs that should, but doesn’t, alter the car’s behavior.
The researchers endorsed their method using video games, with a simulated human correcting the learned path of an on-screen character. The next step is to integrate the model with traditional training and testing approaches for autonomous cars and robots with human feedback.
Co-authors on the papers are Julie Shah, an associate professor in the Department of Aeronautics and Astronautics and head of the CSAIL’s Interactive Robotics Group; and Ece Kamar, Debadeepta Dey, and Eric Horvitz — all from Microsoft Research. “When the system is deployed into the real world, it can use learned model to act more cautiously and intelligently,” said Ramakrishnan.