IMPALA: Scalable Distributed DeepRL in DMLab-30 DeepMind

The tasks are designed to be as varied as possible. They differ in the goals they target, from learning, to memory, to navigation. They vary visually, from brightly coloured, modern-styled texture, to the subtle brown and greens of a desert at dawn, midday, or by night. And they contain physically different settings, from open, mountainous terrain, to right-angled mazes, to open, circular rooms. In addition, some of the environments include'bots', with their own, internal, goal-oriented behaviours.