mlsanityData to 7 Oct 2026

From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labs

arXiv 2510.18104 ↗First posted 20 Oct 2025cs.IR cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recommender-systems research has accelerated model and evaluation advances, yet largely neglects automating the research process itself. We argue for a shift from narrow AutoRecSys tools -- focused on algorithm selection and hyper-parameter tuning -- to an Autonomous Recommender-Systems Research Lab (AutoRecLab) that integrates end-to-end automation: problem ideation, literature analysis, experimental design and execution, result interpretation, manuscript drafting, and provenance logging. Drawing on recent progress in automated science (e.g., multi-agent AI Scientist and AI Co-Scientist systems), we outline an agenda for the RecSys community: (1) build open AutoRecLab prototypes that combine LLM-driven ideation and reporting with automated experimentation; (2) establish benchmarks and competitions that evaluate agents on producing reproducible RecSys findings with minimal human input; (3) create review venues for transparently AI-generated submissions; (4) define standards for attribution and reproducibility via detailed research logs and metadata; and (5) foster interdisciplinary dialogue on ethics, governance, privacy, and fairness in autonomous research. Advancing this agenda can increase research throughput, surface non-obvious insights, and position RecSys to contribute to emerging Artificial Research Intelligence. We conclude with a call to organise a community retreat to coordinate next steps and co-author guidance for the responsible integration of automated research systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

12 of 16 references.

References · 12

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  2. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  3. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  4. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  5. 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
  6. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
  7. 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 54
  8. 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
  9. 2025Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?cited by 32
  10. 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 17
  11. 2020Auto-Surprise: An Automated Recommender-System (AutoRecSys) Library with Tree of Parzens Estimator (TPE) Optimizationcited by 7
  12. 2024The Potential of AutoML for Recommender Systemscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.