Few-ShotParameter-EfficientFine-TuningisBetter andCheaperthanIn-ContextLearning

Few-shot in-context learning (ICL) enables pre-trained language models to perform apreviously-unseen task without anygradient-based training by feeding a small number of training examples as part of the input.