GPT-3 is the future. But what can NLP do in the present?

A lot of ink has been spilled (or pixels illuminated) about the wonders of GPT-3, OpenAI's latest and greatest language model. A team of more than 30 OpenAI researchers have released a paper about GPT-3, a language model capable of achieving state-of-the-art results on a set of benchmark and unique natural language processing tasks that range from language translation to generating news articles to answering SAT questions. But like most examples spat out by language models, almost all of these were hand-selected by humans after many runs. Because not-so-good results just wouldn't make the news. Even bearing that in mind, I'm still blown away by what I've seen of GPT-3.