Uber AI plays any Atari 2600 game with 'superhuman' skill

A team of Uber AI researchers has developed a set of algorithms, Go-Explore, that reportedly beats any Atari 2600 game with "superhuman" scores, including ones where AI previously had trouble besting its organic rivals. The key is a system that takes care to remember promising states and returns to those states before it sets out exploring. Go-Explore saw improvement by "orders of magnitude" in some games. It was the first to beat every level in Montezuma's Revenge, and got a "near-perfect" Pitfall score -- both of these are particularly challenging for reinforcement learning systems like this. DeepMind's Agent57 reached a similar benchmark, according to the team's Jeff Clune, but through "entirely different methods."