Stress-TestingLong-ContextLanguageModels withLifelongICLandTaskHaystack

We introduce Lifelong ICL, a problem setting that challenges long-context language models (LMs) to learn a sequence of language tasks through in-context learning(ICL).