The accessibility of GPT-2 -- text generation and fine-tuning

Natural Language Generation (NLG) is a well studied subject among the NLP community. With the rise of deep learning methods, NLG has become better and better. Recently, OpenAI has pushed the limits, with the release of GPT-2 -- a Transformers based model that predicts the next token at each time space. Nowadays it's quite easy to use these models -- you don't need to implement the code yourself, or train the models using expensive resources. HuggingFace, for instance, has released an API that eases the access to the pretrained GPT-2 OpenAI has published.