Exploring Length Generalization in Large Language Models Cem Anil 1, 3, Yuhuai Wu

However, in these domains, the number of available problems typically drops rapidly as a function of problem length (e.g. Figure 2).