The Transient Nature of Emergent In-Context Learning in Transformers Aaditya K. Singh Gatsby Unit, UCL Stephanie C.Y. Chan