An AI that can play Goat Simulator is a step toward more useful machines

In training AI systems, games are a good proxy for real-world tasks. "A general game-playing agent could, in principle, learn a lot more about how to navigate our world than anything in a single environment ever could," says Michael Bernstein, an associate professor of computer science at Stanford University, who was not part of the research. "One could imagine one day rather than having superhuman agents which you play against, we could have agents like SIMA playing alongside you in games with you and with your friends," says Tim Harley, a research engineer at Google DeepMind who was part of the team that developed the agent. The team trained SIMA on lots of examples of humans playing video games, both individually and collaboratively, alongside keyboard and mouse input and annotations of what the players did in the game, says Frederic Besse, a research engineer at Google DeepMind. Then they used an AI technique called imitation learning to teach the agent to play games as humans would.