From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labs
Beel, Joeran, Gipp, Bela, Vente, Tobias, Baumgart, Moritz, Meister, Philipp
–arXiv.org Artificial Intelligence
Recommender-systems research has accelerated model and evaluation advances, yet largely neglects automating the research process itself. We argue for a shift from narrow AutoRecSys tools -- focused on algorithm selection and hyper-parameter tuning -- to an Autonomous Recommender-Systems Research Lab (AutoRecLab) that integrates end-to-end automation: problem ideation, literature analysis, experimental design and execution, result interpretation, manuscript drafting, and provenance logging. Drawing on recent progress in automated science (e.g., multi-agent AI Scientist and AI Co-Scientist systems), we outline an agenda for the RecSys community: (1) build open AutoRecLab prototypes that combine LLM-driven ideation and reporting with automated experimentation; (2) establish benchmarks and competitions that evaluate agents on producing reproducible RecSys findings with minimal human input; (3) create review venues for transparently AI-generated submissions; (4) define standards for attribution and reproducibility via detailed research logs and metadata; and (5) foster interdisciplinary dialogue on ethics, governance, privacy, and fairness in autonomous research. Advancing this agenda can increase research throughput, surface non-obvious insights, and position RecSys to contribute to emerging Artificial Research Intelligence. We conclude with a call to organise a community retreat to coordinate next steps and co-author guidance for the responsible integration of automated research systems.
arXiv.org Artificial Intelligence
Oct-22-2025
- Country:
- Europe
- Belgium > Flanders
- Antwerp Province > Antwerp (0.04)
- Germany
- Lower Saxony > Gottingen (0.04)
- North Rhine-Westphalia > Arnsberg Region
- Siegen (0.05)
- Belgium > Flanders
- Europe
- Genre:
- Research Report (1.00)
- Industry:
- Health & Medicine (0.48)
- Technology: