Can GPT-3 Really Help You and Your Company?
GPT-3 is a new text-generating program from OpenAI. This model is pre-trained, but it is never touched again. Specifically, they trained GPT-3 on a dataset of half a trillion words for 175 billion parameters, which is 10x more than any previous non-sparse language model. Then, there is no more fine-tuning to do with this model, only a few-shot demonstrations specified purely via text interaction with the model. The few-shot works by giving a certain amount of examples of context and completion, and then one final example of context, with the model expected to provide the completion without changing the model's parameters.
Sep-13-2020, 21:00:19 GMT
- Technology: