Self-EvolveRec: Self-Evolving Recommender Systems with LLM-based Directional Feedback
On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents
Abstract (arXiv)
Traditional methods for automating recommender system design, such as Neural Architecture Search (NAS), are often constrained by a fixed search space defined by human priors, limiting innovation to pre-defined operators. While recent LLM-driven code evolution frameworks shift fixed search space target to open-ended program spaces, they primarily rely on scalar metrics (e.g., NDCG, Hit Ratio) that fail to provide qualitative insights into model failures or directional guidance for improvement. To address this, we propose Self-EvolveRec, a novel framework that establishes a directional feedback loop by integrating a User Simulator for qualitative critiques and a Model Diagnosis Tool for quantitative internal verification. Furthermore, we introduce a Diagnosis Tool - Model Co-Evolution strategy to ensure that evaluation criteria dynamically adapt as the recommendation architecture evolves. Extensive experiments demonstrate that Self-EvolveRec significantly outperforms state-of-the-art NAS and LLM-driven code evolution baselines in both recommendation performance and user satisfaction. Our code is available at https://github.com/Sein-Kim/self_evolverec.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 29 of its 61 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
29 of 61 references.
References · 29
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2017Neural Collaborative Filteringcited by 1,111
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2019Neural Graph Collaborative Filteringcited by 661
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
17 more
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 143
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2020Towards Automated Neural Interaction Discovery for Click-Through Rate Predictioncited by 37
- 2022AutoML for Deep Recommender Systems: A Surveycited by 29
- 2023LLM Performance Predictors are good initializers for Architecture Searchcited by 29
- 2024AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Searchcited by 28
- 2025RecoWorld: Building Simulated Environments for Agentic Recommender Systemscited by 19
- 2025Scientific Algorithm Discovery by Augmenting AlphaEvolve with Deep Researchcited by 19
- 2025PUB: An LLM-Enhanced Personality-Driven User Behaviour Simulator for Recommender System Evaluationcited by 12
- 2022AutoLossGen: Automatic Loss Function Generation for Recommender Systemscited by 10
- 2023Task Relation-aware Continual User Representation Learningcited by 7
- 2025A Survey of Real-World Recommender Systems: Challenges, Constraints, and Industrial Perspectivescited by 7
- 2025Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judgecited by 6
- 2024DNS-Rec: Data-aware Neural Architecture Search for Recommender Systemscited by 4
- 2025RecoMind: A Reinforcement Learning Framework for Optimizing In-Session User Satisfaction in Recommendation Systemscited by 3
- 2021Learning-To-Ensemble by Contextual Rank Aggregation in E-Commercecited by 1
- 2025Dynamic Time-aware Continual User Representation Learningcited by 1
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026AgentX: Towards Agent-Driven Self-Iteration of Industrial Recommender Systemscited by 8
- 2026AgenticRecTune: Multi-Agent with Self-Evolving Skillhub for Recommendation System Optimizationcited by 5
- 2026SAGER: Self-Evolving User Policy Skills for Recommendation Agentcited by 3
- 2026Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimizationcited by 1
- 2026SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Strategy Refinement in E-Commerce Recommendationcited by 0
- 2026AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scalecited by 0
- 2026PEAR: Progressive Evidence-Based AutoResearch for Industrial Search Systemscited by 0
- 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Modelscited by 0
- 2026ConflictGuide: AutoResearch Improves When Competing Behaviors Are Made Visiblecited by 0
- 2026PsyBer-Agent: A Psychology-Driven User Agent for Recommender Systemscited by 0
- 2026ConflictGuide: AutoResearch Improves When Competing Behaviors Are Made Visible30 Sep 2026
- 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Models30 Sep 2026
- 2026PEAR: Progressive Evidence-Based AutoResearch for Industrial Search Systems28 Sep 2026
- 2026PsyBer-Agent: A Psychology-Driven User Agent for Recommender Systems26 Sep 2026
- 2026AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scale15 Sep 2026
- 2026SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Strategy Refinement in E-Commerce Recommendation20 Jul 2026
- 2026AgentX: Towards Agent-Driven Self-Iteration of Industrial Recommender Systems25 Jun 2026
- 2026Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization18 May 2026
- 2026AgenticRecTune: Multi-Agent with Self-Evolving Skillhub for Recommendation System Optimization21 Apr 2026
- 2026SAGER: Self-Evolving User Policy Skills for Recommendation Agent16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agents
- 2026EvoRec: Self Evolving Agentic Recommender Systems
- 2026EvoSkillRec: Skill-Genome Evolution for Recommender Architecture Discovery
- 2026RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems
- 2026Rethinking Recommendation Paradigms: From Pipelines to Agentic Recommender Systems
- 2024Language Model Evolutionary Algorithms for Recommender Systems: Benchmarks and Algorithm Comparisons
- 2025AdaptRec: A Self-Adaptive Framework for Sequential Recommendations with Large Language Models
- 2026Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System