Pre-train, Prompt, and Predict – Part1 – Towards AI

Originally published on Towards AI. I came across this wonderful paper on Prompting while going through this amazing course on Advanced NLP (UMass). Being a survey paper, they have given a holistic explanation of this latest paradigm in NLP. Over multiple articles, we will be discussing the key highlights from the paper and learn why Prompting is considered to be "The Second Sea Change in NLP". To appreciate what is prompting and to get started, Part 1 discusses 4 major paradigms that have occurred over the past years.