The AI's Carol

In 2017 I decided to find out what would happen if I trained a neural net on 240 Christmas carols (collected by The Times of London and reader/neural net hobbyist Erik Svensson). Run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolph, run, run Rudolf the new born King. You can kind of understand where the confusion came from. But that was 2017, when I was training char-rnn from scratch on my laptop. Now in 2019 I have access to the much more powerful GPT-2, trained by OpenAI on 40GB of text from the internet.