mlsanityData to 7 Oct 2026

Positivity-free Policy Learning with Observational Data

arXiv 2310.06969 ↗First posted 10 Oct 2023stat.ME cs.LG stat.MLcited by 6

Not on the map. Why?

Abstract (arXiv)

Policy learning utilizing observational data is pivotal across various domains, with the objective of learning the optimal treatment assignment policy while adhering to specific constraints such as fairness, budget, and simplicity. This study introduces a novel positivity-free (stochastic) policy learning framework designed to address the challenges posed by the impracticality of the positivity assumption in real-world scenarios. This framework leverages incremental propensity score policies to adjust propensity score values instead of assigning fixed values to treatments. We characterize these incremental propensity score policies and establish identification conditions, employing semiparametric efficiency theory to propose efficient estimators capable of achieving rapid convergence rates, even when integrated with advanced machine learning algorithms. This paper provides a thorough exploration of the theoretical guarantees associated with policy learning and validates the proposed framework's finite-sample performance through comprehensive numerical experiments, ensuring the identification of causal effects from observational data is both robust and reliable.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 32 of its 72 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

32 of 72 references.

References · 32

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  3. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
  4. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
  5. 2016Generalized Random Forestscited by 309
  6. 2015Doubly Robust Policy Evaluation and Optimizationcited by 158
  7. 2019Orthogonal Statistical Learningcited by 150
  8. 2022Semiparametric doubly robust targeted double machine learning: a reviewcited by 129
  9. 2020Fair Regression with Wasserstein Barycenterscited by 99
  10. 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 92
  11. 2023Fairlearn: Assessing and Improving Fairness of AI Systemscited by 74
  12. 2018Confounding-Robust Policy Improvementcited by 73
20 more
  1. 2018Offline Multi-Action Policy Learning: Generalization and Optimizationcited by 64
  2. 2022Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequalitycited by 32
  3. 2020Estimating heterogeneous treatment effects with right-censored data via causal survival forestscited by 29
  4. 2017Nonparametric causal effects based on incremental propensity score interventionscited by 28
  5. 2018Sharp instruments for classifying compliers and generalizing causal effectscited by 22
  6. 2022Robust and Agnostic Learning of Conditional Distributional Treatment Effectscited by 18
  7. 2022Estimating Total Treatment Effect in Randomized Experiments with Unknown Network Structurecited by 18
  8. 2022Causal Estimation for Text Data with (Apparent) Overlap Violationscited by 15
  9. 2017Counterfactual Learning from Bandit Feedback under Deterministic Logging: A Case Study in Statistical Machine Translationcited by 13
  10. 2021Risk Minimization from Adaptively Collected Data: Guarantees for Supervised and Policy Learningcited by 10
  11. 2023Policy Learning under Biased Sample Selectioncited by 9
  12. 2020Efficient Evaluation of Natural Stochastic Policies in Offline Reinforcement Learningcited by 8
  13. 2022Staggered Rollout Designs Enable Causal Inference Under Interference Without Network Knowledgecited by 8
  14. 2017Tree based weighted learning for estimating individualized treatment rules with censored datacited by 5
  15. 2023Efficient and robust transfer learning of optimal individualized treatment regimes with right-censored survival datacited by 5
  16. 2023Bayesian Safe Policy Learning with Chance Constrained Optimization: Application to Military Security Assessment during the Vietnam Warcited by 4
  17. 2023Off-policy evaluation beyond overlap: partial identification through smoothnesscited by 3
  18. 2023Average treatment effect on the treated, under lack of positivitycited by 3
  19. 2023Causal Effect Estimation after Propensity Score Trimming with Continuous Treatmentscited by 2
  20. 2022Inference on the Best Policies with Many Covariatescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 2.

6 papers.