Robots that learn as they fail could unlock a new era of AI

Pinto's working to fix that. A computer science researcher at New York University, he wants to see robots in the home that do a lot more than vacuum: "How do we actually create robots that can be a more integral part of our lives, doing chores, doing elder care or rehabilitation--you know, just being there when we need them?" The problem is that training multiskilled robots requires lots of data. Pinto's solution is to find novel ways to collect that data--in particular, getting robots to collect it as they learn, an approach called self-supervised learning (a technique also championed by Meta's chief AI scientist and Pinto's NYU colleague Yann LeCun, among others). "Lerrel's work is a major milestone in bringing machine learning and robotics together," says Pieter Abbeel, director of the robot learning lab at the University of California, Berkeley.