The emerging types of language models and why they matter – TechCrunch

AI systems that understand and generate text, known as language models, are the hot new thing in the enterprise. A recent survey found that 60% of tech leaders said that their budgets for AI language technologies increased by at least 10% in 2020 while 33% reported a 30% increase. But not all language models are created equal. Several types are emerging as dominant, including large, general-purpose models like OpenAI's GPT-3 and models fine-tuned for particular tasks (think answering IT desk questions). At the edge exists a third category of model -- one that tends to be highly compressed in size and limited to few capabilities, designed specifically to run on Internet of Things devices and workstations.