Playing FPS games with deep reinforcement learning

When I wrote up'Asynchronous methods for deep learning' last month, I made a throwaway remark that after Go the next challenge for deep learning systems would be to win an esports competition against the best human teams. Can you imagine the theatre! Since those are team competitions, it would need to be a team of collaborating software agents playing against human teams. Which would make for some very cool AI technology. Today's paper isn't quite at that level yet, but it does show that progress is already being made on playing first-person shooter (FPS) games in 3D environments.