Top 8 research papers by DeepMind in 2022 (till date)

DeepMind's researchers are working round the clock to push the frontiers of AI. The lab has published 34 research papers in the last four months. Let's look at the key papers the Alphabet subsidiary has published in 2022. The paper found the model size and the training dataset size should be scaled in equal measure for compute-optimal training. The researchers tested the theory by training a compute-optimal model, Chinchilla, using the same compute budget as Gopher but with 70B parameters and 4x more data.