Nvidia and Microsoft's new model may trump GPT-3 in race to NLP supremacy

Chipmaker Nvidia and Microsoft claim they have built the world's largest artificial intelligence (AI) powered language model to date. The model, called the Megatron-Turing Natural Language Generation (MT-NLP) is a successor to the two companies' earlier work, which gave rise to the Turing NLG 17B and Megatron-LM models. It contains 530 parameters, which the companies claim will bring "unmatched" accuracy when the AI is put to work on natural learning tasks. This includes reading, common sense reasoning, word sense disambiguation and natural language inferences. In comparison to MT-NLP, OpenAI's GPT-3 AI has only 175 billion parameters.