Google's New AI Gets Smarter Thanks to a Working Memory

Back in early 2015, Google's mysterious DeepMind unveiled an algorithm that could teach itself to play Atari games. Based on deep neural nets, the AI impressively mastered nostalgic favorites such as Space Invaders and Pong without needing any explicit programming -- it simply learned through millions of examples. But the algorithm had a weakness: memory. Without a memory module, it couldn't store away any information it had already mastered. When faced with problems requiring multi-step reasoning, the algorithm faltered.