The Transient Nature of Emergent In-Context Learning in Transformers Aaditya K. Singh Gatsby Unit, UCL Stephanie C.Y. Chan

Oct-10-2025, 23:18:49 GMT–Neural Information Processing Systems 

Transformer neural networks can exhibit a surprising capacity for in-context learning (ICL) despite not being explicitly trained for it.