How Good is Your Chatbot? An Introduction to Perplexity in NLP

New, state-of-the-art language models like DeepMind's Gopher, Microsoft's Megatron, and OpenAI's GPT-3 are driving a wave of innovation in NLP. How do you measure the performance of these language models to see how good they are? In a previous post, we gave an overview of different language model evaluation metrics. This post dives more deeply into one of the most popular: a metric known as perplexity. Surge AI delivers better data, faster.