Shall we play a game? A GPT-2 text adventure

When I read Ender's Game, one of the parts that most stuck with me was the delightfully creepy Mind Game–a game designed to probe the player's subconcious. In the book, we learn that the Mind Game isn't actually programmed–it's powered by an AI that makes up the gameplay as it goes, reacting to the player's decisions and getting progressively more surreal. Ender's Game was written in 1985, and since then AI has actually gotten pretty good at creative tasks since then. The real-time graphics of something like the Mind Game are probably still out of reach, but what about something simpler like a text adventure? I decided to try writing a game like this by training GPT-2, a state-of-the-art predictive text model, on some transcripts of classic text advetnures.