AI devs created a lean, mean, GPT-3-beating machine that uses 99.9% fewer parameters

#artificialintelligence 

AI researchers from the Ludwig Maximilian University (LMU) of Munich have developed a bite-sized text generator capable of besting OpenAI's state of the art GPT-3 using only a tiny fraction of its parameters. GPT-3 is a monster of an AI system capable of responding to almost any text prompt with unique, original responses that are often surprisingly cogent. It's an example of what incredibly talented developers can do with cutting-edge algorithms and software when given unfettered access to supercomputers. At least not when compared to a new system developed by LMU researchers Timo Schick and Hinrich Schutze. According to a recent pre-print paper on arXiv, the duo's system outperforms GPT-3 on the "superGLUE" benchmark test with only 223 million parameters: In this work, we show that performance similar to GPT-3 can be obtained with language models whose parameter count is several orders of magnitude smaller.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found