Positivity-free Policy Learning with Observational Data
Not on the map. Why?
Abstract (arXiv)
Policy learning utilizing observational data is pivotal across various domains, with the objective of learning the optimal treatment assignment policy while adhering to specific constraints such as fairness, budget, and simplicity. This study introduces a novel positivity-free (stochastic) policy learning framework designed to address the challenges posed by the impracticality of the positivity assumption in real-world scenarios. This framework leverages incremental propensity score policies to adjust propensity score values instead of assigning fixed values to treatments. We characterize these incremental propensity score policies and establish identification conditions, employing semiparametric efficiency theory to propose efficient estimators capable of achieving rapid convergence rates, even when integrated with advanced machine learning algorithms. This paper provides a thorough exploration of the theoretical guarantees associated with policy learning and validates the proposed framework's finite-sample performance through comprehensive numerical experiments, ensuring the identification of causal effects from observational data is both robust and reliable.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 32 of its 72 references that are in the map. First posted on arXiv 10 Oct 2023.
Builds on
32 of 72 references.
References · 32
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
- 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
- 2016Generalized Random Forestscited by 309
- 2015Doubly Robust Policy Evaluation and Optimizationcited by 158
- 2019Orthogonal Statistical Learningcited by 150
- 2022Semiparametric doubly robust targeted double machine learning: a reviewcited by 129
- 2020Fair Regression with Wasserstein Barycenterscited by 99
- 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 92
- 2023Fairlearn: Assessing and Improving Fairness of AI Systemscited by 74
- 2018Confounding-Robust Policy Improvementcited by 73
20 more
- 2018Offline Multi-Action Policy Learning: Generalization and Optimizationcited by 64
- 2022Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequalitycited by 32
- 2020Estimating heterogeneous treatment effects with right-censored data via causal survival forestscited by 29
- 2017Nonparametric causal effects based on incremental propensity score interventionscited by 28
- 2018Sharp instruments for classifying compliers and generalizing causal effectscited by 22
- 2022Robust and Agnostic Learning of Conditional Distributional Treatment Effectscited by 18
- 2022Estimating Total Treatment Effect in Randomized Experiments with Unknown Network Structurecited by 18
- 2022Causal Estimation for Text Data with (Apparent) Overlap Violationscited by 15
- 2017Counterfactual Learning from Bandit Feedback under Deterministic Logging: A Case Study in Statistical Machine Translationcited by 13
- 2021Risk Minimization from Adaptively Collected Data: Guarantees for Supervised and Policy Learningcited by 10
- 2023Policy Learning under Biased Sample Selectioncited by 9
- 2020Efficient Evaluation of Natural Stochastic Policies in Offline Reinforcement Learningcited by 8
- 2022Staggered Rollout Designs Enable Causal Inference Under Interference Without Network Knowledgecited by 8
- 2017Tree based weighted learning for estimating individualized treatment rules with censored datacited by 5
- 2023Efficient and robust transfer learning of optimal individualized treatment regimes with right-censored survival datacited by 5
- 2023Bayesian Safe Policy Learning with Chance Constrained Optimization: Application to Military Security Assessment during the Vietnam Warcited by 4
- 2023Off-policy evaluation beyond overlap: partial identification through smoothnesscited by 3
- 2023Average treatment effect on the treated, under lack of positivitycited by 3
- 2023Causal Effect Estimation after Propensity Score Trimming with Continuous Treatmentscited by 2
- 2022Inference on the Best Policies with Many Covariatescited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 2.
6 papers.
- 2024Combining Experimental and Historical Data for Policy Evaluationcited by 6
- 2025Joint Value Estimation and Bidding in Repeated First-Price Auctionscited by 6
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMscited by 4
- 2025DOLCE: Decomposing Off-Policy Evaluation/Learning into Lagged and Current Effectscited by 0
- 2026Pessimistic Risk-Aware Policy Learning in Contextual Banditscited by 0
- 2026Wasserstein Policy Learning for Distributional Outcomescited by 0
- 2026Wasserstein Policy Learning for Distributional Outcomes17 Jun 2026
- 2026Pessimistic Risk-Aware Policy Learning in Contextual Bandits15 May 2026
- 2025DOLCE: Decomposing Off-Policy Evaluation/Learning into Lagged and Current Effects2 May 2025
- 2025Joint Value Estimation and Bidding in Repeated First-Price Auctions24 Feb 2025
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMs28 Oct 2024
- 2024Combining Experimental and Historical Data for Policy Evaluation1 Jun 2024