BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data

Jumelet, Jaap, Fourtassi, Abdellah, Haga, Akari, Bunzeck, Bastian, Shandilya, Bhargav, Galvan-Sosa, Diana, Haznitrama, Faiz Ghifari, Padovani, Francesca, Meyer, Francois, Hu, Hai, Etxaniz, Julen, Prévot, Laurent, He, Linyang, Grandury, María, Marcheva, Mila, Foroutan, Negar, Theodoropoulos, Nikitas, Sadeghi, Pouya, Song, Siyuan, Salhan, Suchir, Zhou, Susana, Paniv, Yurii, Zhang, Ziyin, Bisazza, Arianna, Warstadt, Alex, Choshen, Leshem

arXiv.org Artificial Intelligence 

We present BabyBabelLM, a multilingual collection of datasets modeling the language a person observes from birth until they acquire a native language. We curate developmentally plausible pretraining data aiming to cover the equivalent of 100M English words of content in each of 45 languages. We compile evaluation suites and train baseline models in each language. BabyBabelLM aims to facilitate multilingual pretraining and cognitive modeling.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found