Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer

Large language models (LLMs) such as T0, FLAN, and OPT-IML, excel in multitasking under a unified instruction-following paradigm, where they also exhibit remarkable generalization abilities to unseen tasks.