Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer Bowen T an 1, Y un Zhu

Furthermore, adapting these models to downstream applications, particularly complex tasks, is often unfeasible due to the extensive hardware requirements for finetuning, even when utilizing parameter-efficient approaches such as prompt tuning.