OpenAI Retro Contest

In this contest, participants try to create the best agent for playing custom levels of the Sonic games -- without having access to those levels during development. See our blog post for more details. This process is illustrated in the schematic below. We believe that the next step for reinforcement learning is to leverage past experience to quickly learn new environments. Current algorithms are very prone to memorization and can't adapt well to new situations.