Recommendations as Treatments: Debiasing Learning and Evaluation
Not on the map. Why?
Abstract (arXiv)
Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach to handling selection biases, adapting models and estimation techniques from causal inference. The approach leads to unbiased performance estimators despite biased data, and to a matrix factorization method that provides substantially improved prediction performance on real-world data. We theoretically and empirically characterize the robustness of the approach, finding that it is highly practical and scalable.
Key facts. Cited by 246 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 37; 2022: 53; 2023: 51; 2024: 34; 2025: 31; 2026: 40.
246 papers.
Sort:
By area:
- 2023Data Distillation: A Surveycited by 86
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
- 2021AutoDebias: Learning to Debias for Recommendationcited by 68
- 2022ESCM2: Entire Space Counterfactual Multi-Task Model for Post-Click Conversion Rate Estimationcited by 47
- 2021Causal Matrix Completioncited by 45
- 2024CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendationcited by 44
- 2023A Survey on Popularity Bias in Recommender Systemscited by 42
- 2021SurvTRACE: Transformers for Survival Analysis with Competing Eventscited by 40
- 2021Understanding the role of importance weighting for deep learningcited by 38
- 2022Anticipating Performativity by Predicting from Predictionscited by 37
- 2022Generalized Strategic Classification and the Case of Aligned Incentivescited by 34
- 2022Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequalitycited by 32
38 more
- 2023A Trip Towards Fairness: Bias and De-Biasing in Large Language Modelscited by 32
- 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
- 2023RAH! RecSys-Assistant-Human: A Human-Centered Recommendation Framework with LLM Agentscited by 30
- 2021Enhanced Doubly Robust Learning for Debiasing Post-click Conversion Rate Estimationcited by 28
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2022StableDR: Stabilized Doubly Robust Learning for Recommendation on Data Missing Not at Randomcited by 24
- 2021Policy Learning with Adaptively Collected Datacited by 21
- 2021Top-N Recommendation with Counterfactual User Preference Simulationcited by 21
- 2022Fair ranking: a critical review, challenges, and future directionscited by 21
- 2022Trustworthy Recommender Systemscited by 21
- 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21
- 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 19
- 2022TDR-CL: Targeted Doubly Robust Collaborative Learning for Debiased Recommendationscited by 18
- 2022Respecting Transfer Gap in Knowledge Distillationcited by 18
- 2022A Generalized Doubly Robust Learning Framework for Debiasing Post-Click Conversion Rate Predictioncited by 18
- 2023Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendationscited by 18
- 2021Correcting Exposure Bias for Link Recommendationcited by 17
- 2022CausPref: Causal Preference Learning for Out-of-Distribution Recommendationcited by 17
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Datasetcited by 15
- 2021Obtaining Calibrated Probabilities with Personalized Ranking Modelscited by 15
- 2023Importance-Weighted Offline Learning Done Rightcited by 15
- 2021On component interactions in two-stage recommender systemscited by 14
- 2021Deconfounded Causal Collaborative Filteringcited by 14
- 2022Breaking Feedback Loops in Recommender Systems with Causal Inferencecited by 14
- 2023A Survey on Fairness-aware Recommender Systemscited by 14
- 2023Off-Policy Evaluation for Large Action Spaces via Policy Convolutioncited by 14
- 2021Causal Collaborative Filteringcited by 13
- 2021Multi-Source Causal Inference Using Control Variatescited by 13
- 2022Entire Space Counterfactual Learning for Reliable Content Recommendationscited by 13
- 2022Causal Disentanglement for Semantics-Aware Intent Learning in Recommendationcited by 12
- 2022Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted Microservicescited by 12
- 2023Robust Collaborative Filtering to Popularity Distribution Shiftcited by 12
- 2022Multiple Robust Learning for Recommendationcited by 11
- 2022Unbiased Knowledge Distillation for Recommendationcited by 11
- 2023Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobaocited by 11
- 2024Leave No Patient Behind: Enhancing Medication Recommendation for Rare Disease Patientscited by 11
- 2024Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendationscited by 11
50 most cited of 246 All 246 (JSON)
- 2026Challenges and Solutions for Bandits in the Wild: Warm-Started Mixture Bandits for Cross-Cohort Slate Recommendation29 Sep 2026
- 2026Recommendation Ranking Off-Policy Evaluation under Ranking-Dependent Examination via Examination-Relevance Decomposition28 Sep 2026
- 2026Learning Collective Dynamics with Differentiable Gaussian Representations23 Sep 2026
- 2026Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data11 Sep 2026
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026The Recall Ceiling of LLM Recommendation Reranking27 Aug 2026
- 2026Incremental Recommendation via Causal Models27 Aug 2026
- 2026Beyond Observed Auxiliary Relations: Environment-Conditioned Modeling for Multi-Behavior Recommendation24 Aug 2026
- 2026Dear Algo: A Precision-First Agentic Intent Layer for Unified Search and Recommendation16 Aug 2026
- 2026Doubly Robust Estimation of Causal Effect on CVR with Targeted Regularization13 Aug 2026
- 2026Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targeting5 Aug 2026
- 2026ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors2 Aug 2026
38 more
- 2026Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platform31 Jul 2026
- 2026CALMRec: Causally Aligned Language Memory for Long-Horizon Recommendation26 Jul 2026
- 2026TLRNet: Estimating Individual Treatment Effect based on Local Information and Single Learner Structure23 Jul 2026
- 2026SalesLoop: Reinforcement Learning from Performance Feedback for Sales Lead Ranking22 Jul 2026
- 2026OrDA: Orthogonal Disentanglement of Access Habits Framework for Homepage Marketing Block Recommendations15 Jul 2026
- 2026Simulating Eutopia: Revisiting Long-term Fairness with Outcomes, Performativity, and Dynamics2 Jul 2026
- 2026Cross-Head Attention Uplift Network with Inverse Propensity Score under Unobserved Confounding25 Jun 2026
- 2026Representation Curriculum: Stagewise Training for Robust Ranking and Allocation3 Jun 2026
- 2026Benchmarking Recursive-Collapse Warning Claims Under Matched False-Positive Control29 May 2026
- 2026Causal Representation Learning for Generalisable Recommendation26 May 2026
- 2026PEARL: Unbiased Percentile Estimation via Contrastive Learning for Industrial-Scale Livestream Recommendation20 May 2026
- 2026PUID: A Personalized Deconfounding Framework for Recommender Systems under Hidden Confounding20 May 2026
- 2026StruMPL: Multi-task Dense Regression under Disjoint Partial Supervision and MNAR Labels19 May 2026
- 2026Echoes in Filter Bubble: Diagnosing and Curing Popularity Bias in Generative Recommenders16 May 2026
- 2026Correcting Selection Bias in Sparse User Feedback for Large Language Model Quality Estimation: A Multi-Agent Hierarchical Bayesian Approach12 May 2026
- 2026Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering11 May 2026
- 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory10 May 2026
- 2026Temporal Smoothness Doubly Robust Learning for Debiased Knowledge Tracing7 May 2026
- 2026CASP: Support-Aware Offline Policy Selection for Two-Stage Recommender Systems24 Apr 2026
- 2026CAST: Modeling Semantic-Level Transitions for Complementary-Aware Sequential Recommendation21 Apr 2026
- 2026Identifiable Deep Latent Variable Models for MNAR Data25 Mar 2026
- 2026MBD: A Model-Based Debiasing Framework Across User, Content, and Model Dimensions15 Mar 2026
- 2026Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHF10 Mar 2026
- 2026Invariant Causal Routing for Governing Social Norms in Online Market Economies4 Mar 2026
- 2026Learning Preference from Observed Rankings18 Feb 2026
- 2026MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendation11 Feb 2026
- 2026DSL: Understanding and Improving Softmax Recommender Systems with Competition-Aware Scaling6 Feb 2026
- 2026An Efficient Long-Context Ranking Architecture With Calibrated LLM Distillation: Application to Person-Job Fit15 Jan 2026
- 2025Rethinking Popularity Bias in Collaborative Filtering via Analytical Vector Decomposition11 Dec 2025
- 2025Privacy-Utility-Bias Trade-offs for Privacy-Preserving Recommender Systems27 Nov 2025
- 2025Make It Long, Keep It Fast: End-to-End 10K Long User Behavior Sequence Modeling for Billion-Scale Douyin Recommendation8 Nov 2025
- 2025No-Human in the Loop: Agentic Evaluation at Scale for Recommendation4 Nov 2025
- 2025Bi-Level Decision-Focused Causal Learning for Large-Scale Marketing Optimization: Bridging Observational and Experimental Data22 Oct 2025
- 2025BPL: Bias-adaptive Preference Distillation Learning for Recommender System17 Oct 2025
- 2025Causality Enhancement for Cross-Domain Recommendation16 Oct 2025
- 2025Energy-Guided Diffusion Sampling for Long-Term User Behavior Prediction in Reinforcement Learning-based Recommendation9 Oct 2025
- 2025Retentive Relevance: Capturing Long-Term User Value in Recommendation Systems8 Oct 2025
- 2025On Predicting Post-Click Conversion Rate via Counterfactual Inference6 Oct 2025
50 newest of 246 All 246 (JSON)
- 2023RAH! RecSys-Assistant-Human: A Human-Centered Recommendation Framework with LLM Agentscited by 30
- 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memorycited by 3
- 2025No-Human in the Loop: Agentic Evaluation at Scale for Recommendationcited by 2
- 2026Correcting Selection Bias in Sparse User Feedback for Large Language Model Quality Estimation: A Multi-Agent Hierarchical Bayesian Approachcited by 1
- 2026Dear Algo: A Precision-First Agentic Intent Layer for Unified Search and Recommendationcited by 0
- 2026Dear Algo: A Precision-First Agentic Intent Layer for Unified Search and Recommendation16 Aug 2026
- 2026Correcting Selection Bias in Sparse User Feedback for Large Language Model Quality Estimation: A Multi-Agent Hierarchical Bayesian Approach12 May 2026
- 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory10 May 2026
- 2025No-Human in the Loop: Agentic Evaluation at Scale for Recommendation4 Nov 2025
- 2023RAH! RecSys-Assistant-Human: A Human-Centered Recommendation Framework with LLM Agents19 Aug 2023
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
- 2024ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systemscited by 4
- 2026Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHFcited by 0
- 2026Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHF10 Mar 2026
- 2024ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systems18 Jul 2024
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback9 Mar 2023
- 2023Data Distillation: A Surveycited by 86
- 2021AutoDebias: Learning to Debias for Recommendationcited by 68
- 2022ESCM2: Entire Space Counterfactual Multi-Task Model for Post-Click Conversion Rate Estimationcited by 47
- 2021Causal Matrix Completioncited by 45
- 2023A Survey on Popularity Bias in Recommender Systemscited by 42
- 2021SurvTRACE: Transformers for Survival Analysis with Competing Eventscited by 40
- 2021Understanding the role of importance weighting for deep learningcited by 38
- 2022Anticipating Performativity by Predicting from Predictionscited by 37
- 2022Generalized Strategic Classification and the Case of Aligned Incentivescited by 34
- 2022Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequalitycited by 32
- 2023A Trip Towards Fairness: Bias and De-Biasing in Large Language Modelscited by 32
- 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
12 most cited of 230 All 230 (JSON)
- 2026Challenges and Solutions for Bandits in the Wild: Warm-Started Mixture Bandits for Cross-Cohort Slate Recommendation29 Sep 2026
- 2026Recommendation Ranking Off-Policy Evaluation under Ranking-Dependent Examination via Examination-Relevance Decomposition28 Sep 2026
- 2026Learning Collective Dynamics with Differentiable Gaussian Representations23 Sep 2026
- 2026Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data11 Sep 2026
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026The Recall Ceiling of LLM Recommendation Reranking27 Aug 2026
- 2026Incremental Recommendation via Causal Models27 Aug 2026
- 2026Beyond Observed Auxiliary Relations: Environment-Conditioned Modeling for Multi-Behavior Recommendation24 Aug 2026
- 2026Doubly Robust Estimation of Causal Effect on CVR with Targeted Regularization13 Aug 2026
- 2026Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targeting5 Aug 2026
- 2026ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors2 Aug 2026
- 2026Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platform31 Jul 2026
12 newest of 230 All 230 (JSON)