AutoRecLab: Describe the Experiment, Get the Code!
Not on the map. Why?
Abstract (arXiv)
Empirical evaluation is central to recommender-systems (RecSys) research, but turning experimental designs into executable code remains a manual and error-prone task. We present AutoRecLab, a Python-based autonomous RecSys lab that automates RecSys experiments from natural-language prompts. Given a research idea, AutoRecLab derives explicit experiment requirements, builds and validates a prototype, and iteratively expands it into the requested full experiment. The workflow combines retrieval-augmented generation (RAG) for documentation lookup, static type verification, and execution-steered tree search. In our demonstration, AutoRecLab autonomously implements an explicit-to-implicit feedback conversion study. In a baseline comparison across six algorithms and three datasets, 8 of 9 runs succeed at an average cost of approx- imately 1 per run with GPT-5.4-mini.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
13 of 21 references.
References · 13
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
- 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 185
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 138
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 53
- 2025Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?cited by 32
- 2021Elliot: a Comprehensive and Rigorous Framework for Reproducible Recommender Systems Evaluationcited by 28
- 2018LensKit for Python: Next-Generation Software for Recommender System Experimentscited by 13
- 2020Auto-Surprise: An Automated Recommender-System (AutoRecSys) Library with Tree of Parzens Estimator (TPE) Optimizationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System
- 2026AutoLR: Automating the Path from Research to Launch Review in Industrial Recommender Systems
- 2026AgentX: Towards Agent-Driven Self-Iteration of Industrial Recommender Systems
- 2026RecEvolve: A Knowledge-Driven Autonomous Agent System for Recommender Systems
- 2026AutoResearch at Production Scale: Failure Modes and a Multi-Agent Framework
- 2026Self-EvolveRec: Self-Evolving Recommender Systems with LLM-based Directional Feedback
- 2025AgentRecBench: Benchmarking LLM Agent-based Personalized Recommender Systems
- 2026RecToolBench: Benchmarking Recommendation-Specific Tool Orchestration under Fuzzy User Intent