New Projects See GPT-2 Summarizing Movies, Playing Chess

New Netflix and Chess applications have once again illustrated the range and potential of OpenAI's GPT-2 language model. GPT-2 became an overnight sensation when OpenAI released it in February 2019, receiving critical acclaim worldwide. GPT-2 is a successor to GPT, a large transformer-based language model with 1.5 million parameters and trained on 8 million web pages. GPT-2 can automatically generate coherent paragraphs of text, basically predicting the next word given previous words. One of the big challenges for language models is domain-specific datasets that involve a lot of expert knowledge. That's GPT-2's charm point -- it seems free of such constraints, outperforming other language models on specific domains like Wikipedia, news, or books without using any domain-specific training datasets.