r/MachineLearning - [D] What is the SOTA for Natural Language Generation in 2019?

Hierarchical Neural story generation had the most realistic paragraphs of any text generation paper I came across last summer when I was doing research on this topic. I also find it fun that they used a subreddit as their training set (writingprompts). The architecture is a mixture of self attention layers and convolutional layers. Generate a prompt and then generate a full story. I tried to extend their work to prompt, outline, story but the results were meh (they were similar quality to not bothering with the outline step).