RecSim: A Configurable Simulation Platform for Recommender Systems
Not on the map. Why?
Abstract (arXiv)
We propose RecSim, a configurable platform for authoring simulation environments for recommender systems (RSs) that naturally supports sequential interaction with users. RecSim allows the creation of new environments that reflect particular aspects of user behavior and item structure at a level of abstraction well-suited to pushing the limits of current reinforcement learning (RL) and RS techniques in sequential interactive recommendation problems. Environments can be easily configured that vary assumptions about: user preferences and item familiarity; user latent state and its dynamics; and choice models and other user response behavior. We outline how RecSim offers value to RL and RS researchers and practitioners, and how it can serve as a vehicle for academic-industrial collaboration.
Key facts. Cited by 91 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 13; 2023: 16; 2024: 19; 2025: 14; 2026: 12.
91 papers.
Sort:
By area:
- 2023User Behavior Simulation with Large Language Model based Agentscited by 136
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
- 2023On Generative Agents in Recommendationcited by 88
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 56
- 2024LLM-Powered User Simulator for Recommender Systemcited by 38
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2025Towards Agentic Recommender Systems in the Era of Multimodal Large Language Modelscited by 25
- 2022Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelinescited by 22
- 2021RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystemscited by 21
38 more
- 2021Measuring Recommender System Effects with Simulated Userscited by 20
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 19
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigmscited by 17
- 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
- 2021On Covariate Shift of Latent Confounders in Imitation and Reinforcement Learningcited by 14
- 2026A Survey on LLM-based Conversational User Simulationcited by 14
- 2023On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendationcited by 13
- 2021T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systemscited by 12
- 2024Accounting for AI and Users Shaping One Another: The Role of Mathematical Modelscited by 11
- 2024SUBER: An RL Environment with Simulated Human Behavior for Recommender Systemscited by 11
- 2025YuLan-OneSim: Towards the Next Generation of Social Simulator with Large Language Modelscited by 11
- 2021Variation Control and Evaluation for Generative SlateRecommendationscited by 10
- 2026ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenderscited by 10
- 2021Towards Content Provider Aware Recommender Systems: A Simulation Study on the Interplay between User and Provider Utilitiescited by 9
- 2023Optimizing Audio Recommendations for the Long-Term: A Reinforcement Learning Perspectivecited by 8
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systemscited by 8
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agentscited by 8
- 2021Simulations in Recommender Systems: An industry perspectivecited by 6
- 2022Balancing Consumer and Business Value of Recommender Systems: A Simulation-based Analysiscited by 6
- 2025Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Actioncited by 6
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Tracescited by 6
- 2021RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender Systemcited by 5
- 2022Synthetic Data-Based Simulators for Recommender Systems: A Surveycited by 5
- 2023Sim2Rec: A Simulator-based Decision-making Approach to Optimize Real-World Long-term User Engagement in Sequential Recommender Systemscited by 5
- 2023AURO: Reinforcement Learning for Adaptive User Retention Optimization in Recommender Systemscited by 5
- 2023RetailSynth: Synthetic Data Generation for Retail AI Systems Evaluationcited by 5
- 2024Advancing Retail Data Science: Comprehensive Evaluation of Synthetic Datacited by 5
- 2021Understanding Longitudinal Dynamics of Recommender Systems with Agent-Based Modeling and Simulationcited by 4
- 2023Zero-Shot Recommendations with Pre-Trained Large Language Models for Multimodal Nudgingcited by 4
- 2024Simulation-Based Benchmarking of Reinforcement Learning Agents for Personalized Retail Promotionscited by 4
- 2024Reward Guidance for Reinforcement Learning Tasks Based on Large Language Models: The LMGT Frameworkcited by 4
- 2024Active Inference and Human--Computer Interactioncited by 4
- 2025InfoBid: A Simulation Framework for Studying Information Disclosure in Auctions with Large Language Model-based Agentscited by 4
- 2025Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systemscited by 4
- 2021Imitate TheWorld: A Search Engine Simulation Platformcited by 3
- 2022Learning to Rank For Push Notifications Using Pairwise Expected Regretcited by 3
- 2022Examining Policy Entropy of Reinforcement Learning Agents for Personalization Taskscited by 3
- 2022Learning to Suggest Breaks: Sustainable Optimization of Long-Term User Engagementcited by 3
50 most cited of 91 All 91 (JSON)
- 2026Scalable Multi-Task Inverse Reinforcement Learning30 Sep 2026
- 2026Recommendation World Models for Future-State Control25 Sep 2026
- 2026Learning Collective Dynamics with Differentiable Gaussian Representations23 Sep 2026
- 2026ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors2 Aug 2026
- 2026Affective Music Recommendation: A Rollout-Based World Model for Offline Preference Optimization27 May 2026
- 2026RecoAtlas: From Semantic Plausibility to Set-Level Utility in LLM Recommendation Agents11 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces9 Apr 2026
- 2026Entropy Guided Diversification and Preference Elicitation in Agentic Recommendation Systems12 Mar 2026
- 2026ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenders18 Feb 2026
- 2026PersonaAct: Simulating Short-Video Users with Personalized Agents for Counterfactual Filter Bubble Auditing30 Jan 2026
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing8 Jan 2026
38 more
- 2025Mirroring Users: Towards Building Preference-aligned User Simulator with User Feedback in Recommendation25 Aug 2025
- 2025RecoMind: A Reinforcement Learning Framework for Optimizing In-Session User Satisfaction in Recommendation Systems31 Jul 2025
- 2025Exploitation Over Exploration: Unmasking the Bias in Linear Bandit Recommender Offline Evaluation24 Jul 2025
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agents7 Jun 2025
- 2025GGBond: Growing Graph-Based AI-Agent Society for Socially-Aware Recommender Simulation27 May 2025
- 2025Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems22 May 2025
- 2025YuLan-OneSim: Towards the Next Generation of Social Simulator with Large Language Models12 May 2025
- 2025Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challenges23 Apr 2025
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms23 Apr 2025
- 2025Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Action28 Mar 2025
- 2025InfoBid: A Simulation Framework for Studying Information Disclosure in Auctions with Large Language Model-based Agents26 Mar 2025
- 2025Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models20 Mar 2025
- 2025Decoupled Recommender Systems: Exploring Alternative Recommender Ecosystem Designs5 Mar 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2024LLM-Powered User Simulator for Recommender System22 Dec 2024
- 2024Active Inference and Human--Computer Interaction19 Dec 2024
- 2024Guided Diffusion-based Counterfactual Augmentation for Robust Session-based Recommendation29 Oct 2024
- 2024Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions15 Oct 2024
- 2024PersonalLLM: Tailoring LLMs to Individual Preferences30 Sep 2024
- 2024Minimizing Live Experiments in Recommender Systems: User Simulation to Evaluate Preference Elicitation Policies26 Sep 2024
- 2024FedSlate:A Federated Deep Reinforcement Learning Recommender System23 Sep 2024
- 2024ARTAI: An Evaluation Platform to Assess Societal Risk of Recommender Algorithms19 Sep 2024
- 2024A Hybrid Meta-Learning and Multi-Armed Bandit Approach for Context-Specific Multi-Objective Recommendation Optimization13 Sep 2024
- 2024Reward Guidance for Reinforcement Learning Tasks Based on Large Language Models: The LMGT Framework7 Sep 2024
- 2024Advancing Retail Data Science: Comprehensive Evaluation of Synthetic Data19 Jun 2024
- 2024SUBER: An RL Environment with Simulated Human Behavior for Recommender Systems1 Jun 2024
- 2024Simulation-Based Benchmarking of Reinforcement Learning Agents for Personalized Retail Promotions16 May 2024
- 2024Accounting for AI and Users Shaping One Another: The Role of Mathematical Models18 Apr 2024
- 2024DynaMITE-RL: A Dynamic Model for Improved Temporal Meta-Reinforcement Learning25 Feb 2024
- 2024Debiased Model-based Interactive Recommendation24 Feb 2024
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systems23 Feb 2024
- 2024Towards Off-Policy Reinforcement Learning for Ranking Policies with Human Feedback17 Jan 2024
- 2024MultiSlot ReRanker: A Generic Model-based Re-Ranking Framework in Recommendation Systems11 Jan 2024
- 2023RetailSynth: Synthetic Data Generation for Retail AI Systems Evaluation21 Dec 2023
- 2023Lifting the Veil: Unlocking the Power of Depth in Q-learning27 Oct 2023
- 2023On Generative Agents in Recommendation16 Oct 2023
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systems13 Oct 2023
- 2023AURO: Reinforcement Learning for Adaptive User Retention Optimization in Recommender Systems6 Oct 2023
50 newest of 91 All 91 (JSON)
- 2023User Behavior Simulation with Large Language Model based Agentscited by 136
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
- 2023On Generative Agents in Recommendationcited by 88
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigmscited by 17
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agentscited by 8
- 2025Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Actioncited by 6
- 2025InfoBid: A Simulation Framework for Studying Information Disclosure in Auctions with Large Language Model-based Agentscited by 4
- 2025Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systemscited by 4
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testingcited by 3
- 2026Entropy Guided Diversification and Preference Elicitation in Agentic Recommendation Systemscited by 1
- 2026PersonaAct: Simulating Short-Video Users with Personalized Agents for Counterfactual Filter Bubble Auditingcited by 0
- 2026RecoAtlas: From Semantic Plausibility to Set-Level Utility in LLM Recommendation Agentscited by 0
- 2026RecoAtlas: From Semantic Plausibility to Set-Level Utility in LLM Recommendation Agents11 May 2026
- 2026Entropy Guided Diversification and Preference Elicitation in Agentic Recommendation Systems12 Mar 2026
- 2026PersonaAct: Simulating Short-Video Users with Personalized Agents for Counterfactual Filter Bubble Auditing30 Jan 2026
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing8 Jan 2026
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agents7 Jun 2025
- 2025Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems22 May 2025
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms23 Apr 2025
- 2025Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Action28 Mar 2025
- 2025InfoBid: A Simulation Framework for Studying Information Disclosure in Auctions with Large Language Model-based Agents26 Mar 2025
- 2023On Generative Agents in Recommendation16 Oct 2023
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systems13 Oct 2023
- 2023User Behavior Simulation with Large Language Model based Agents5 Jun 2023
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2024LLM-Powered User Simulator for Recommender Systemcited by 38
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2022Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelinescited by 22
- 2021RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystemscited by 21
- 2021Measuring Recommender System Effects with Simulated Userscited by 20
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 19
- 2026A Survey on LLM-based Conversational User Simulationcited by 14
- 2023On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendationcited by 13
- 2021T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systemscited by 12
12 most cited of 70 All 70 (JSON)
- 2026Learning Collective Dynamics with Differentiable Gaussian Representations23 Sep 2026
- 2026ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors2 Aug 2026
- 2026Affective Music Recommendation: A Rollout-Based World Model for Offline Preference Optimization27 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces9 Apr 2026
- 2026ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenders18 Feb 2026
- 2025RecoMind: A Reinforcement Learning Framework for Optimizing In-Session User Satisfaction in Recommendation Systems31 Jul 2025
- 2025Exploitation Over Exploration: Unmasking the Bias in Linear Bandit Recommender Offline Evaluation24 Jul 2025
- 2025GGBond: Growing Graph-Based AI-Agent Society for Socially-Aware Recommender Simulation27 May 2025
- 2025Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challenges23 Apr 2025
- 2025Decoupled Recommender Systems: Exploring Alternative Recommender Ecosystem Designs5 Mar 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
12 newest of 70 All 70 (JSON)