adc98a266f45005c403b8311ca7e8bd7-Paper-Conference.pdf

Neural Information Processing Systems 

Here, we present an alternative explanation for emergent abilities: for a particular task and model family, when analyzing fixed model outputs, emergent abilities appear due to the researcher's choice of metric rather than due to fundamental changes in models with scale.