Dungeons and Data: A Large-Scale NetHack Dataset Eric Hambro Meta AI Roberta Raileanu Meta AI Danielle Rothermel Meta AI V egard Mella Meta AI Tim Rocktäschel University College London

Neural Information Processing Systems 

In addition, current offline RL benchmarks test agents on the exact same environment where the data was collected.