Artificial Intelligence Innovation: The Future With OpenAI GPT-3

GPT-3 is the 3rd release of the OpenAI collection of Generative Pre-Trained models. GPT-1 and GPT-2 laid the foundations for GPT-3, proving the success of two key hypotheses: Transformers unsupervised pre-training works fine (GPT-1), and language models can multitask (GPT-2). GPT-3 is a language model built on the transformer architecture and pre-trained in an unsupervised, generative manner which has a decent performance in one-shot, zero-shot & few-shot multitask settings. It functions by anticipating the next token in the sequence of tokens, and it can do this for NLP tasks that it's not been taught. After some instances, it reached the highest performance in specific benchmarks, like machine translating, Q&A, and Cloze tasks. GPT-3 was trained on massive Internet text databases, a total of 570GB.