Capture the Flag: the emergence of complex cooperative agents DeepMind

Above: four of our trained agents play together on an indoor and outdoor procedurally generated Capture the Flag level. Billions of people inhabit the planet, each with their own individual goals and actions, but still capable of coming together through teams, organisations and societies in impressive displays of collective intelligence. This is a setting we call multi-agent learning: many individual agents must act independently, yet learn to interact and cooperate with other agents. This is an immensely difficult problem - because with co-adapting agents the world is constantly changing. To investigate this problem we look at 3D first-person multiplayer video games.