RetailSynth: Synthetic Data Generation for Retail AI Systems Evaluation
Not on the map. Why?
Abstract (arXiv)
Significant research effort has been devoted in recent years to developing personalized pricing, promotions, and product recommendation algorithms that can leverage rich customer data to learn and earn. Systematic benchmarking and evaluation of these causal learning systems remains a critical challenge, due to the lack of suitable datasets and simulation environments. In this work, we propose a multi-stage model for simulating customer shopping behavior that captures important sources of heterogeneity, including price sensitivity and past experiences. We embedded this model into a working simulation environment -- RetailSynth. RetailSynth was carefully calibrated on publicly available grocery data to create realistic synthetic shopping transactions. Multiple pricing policies were implemented within the simulator and analyzed for impact on revenue, category penetration, and customer retention. Applied researchers can use RetailSynth to validate causal demand models for multi-category retail and to incorporate realistic price sensitivity into emerging benchmarking suites for personalized pricing, promotions, and product recommendations.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 16 of its 41 references that are in the map. First posted on arXiv 21 Dec 2023.
Builds on
16 of 41 references.
References · 16
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2019RecSim: A Configurable Simulation Platform for Recommender Systemscited by 94
- 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
- 2022Synthetic Data -- what, why and how?cited by 67
- 2018Horizon: Facebook's Open Source Applied Reinforcement Learning Platformcited by 48
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2022Validating Causal Inference Methodscited by 20
- 2017SHOPPER: A Probabilistic Model of Consumer Choice with Substitutes and Complementscited by 14
- 2020MARS-Gym: A Gym framework to model, train, and evaluate Recommender Systems for Marketplacescited by 13
- 2016Estimating Treatment Effects using Multiple Surrogates: The Role of the Surrogate Score and the Surrogate Indexcited by 12
- 2020Foundations of Bayesian Learning from Synthetic Datacited by 10
- 2017TensorFlow Agents: Efficient Batched Reinforcement Learning in TensorFlowcited by 9
4 more
- 2021Toward a Taxonomy of Trust for Probabilistic Machine Learningcited by 8
- 2019Counterfactual Inference for Consumer Choice Across Many Product Categoriescited by 6
- 2019Generating Realistic Sequences of Customer-level Transactions for Retail Datasetscited by 3
- 2020Multi-Purchase Behavior: Modeling, Estimation and Optimizationcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 3.
5 papers.
- 2024Advancing Retail Data Science: Comprehensive Evaluation of Synthetic Datacited by 6
- 2026RetailBench: Benchmarking long horizon reasoning and coherent decision making of LLM agents in realistic retail environmentscited by 6
- 2024Simulation-Based Benchmarking of Reinforcement Learning Agents for Personalized Retail Promotionscited by 4
- 2026RetailBench: Evaluating Long-Horizon Autonomous Decision-Making and Strategy Stability of LLM Agents in Realistic Retail Environmentscited by 1
- 2026PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiationscited by 0
- 2026RetailBench: Benchmarking long horizon reasoning and coherent decision making of LLM agents in realistic retail environments14 Jun 2026
- 2026PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiations19 May 2026
- 2026RetailBench: Evaluating Long-Horizon Autonomous Decision-Making and Strategy Stability of LLM Agents in Realistic Retail Environments17 Mar 2026
- 2024Advancing Retail Data Science: Comprehensive Evaluation of Synthetic Data19 Jun 2024
- 2024Simulation-Based Benchmarking of Reinforcement Learning Agents for Personalized Retail Promotions16 May 2024