Treatment Effect Estimation for Optimal Decision-Making
Not on the map. Why?
Abstract (arXiv)
Decision-making across various fields, such as medicine, heavily relies on conditional average treatment effects (CATEs). Practitioners commonly make decisions by checking whether the estimated CATE is positive, even though the decision-making performance of modern CATE estimators is poorly understood from a theoretical perspective. In this paper, we study optimal decision-making based on two-stage CATE estimators (e.g., DR-learner), which are considered state-of-the-art and widely used in practice. We prove that, while such estimators may be optimal for estimating CATE, they can be suboptimal when used for decision-making. Intuitively, this occurs because such estimators prioritize CATE accuracy in regions far away from the decision boundary, which is ultimately irrelevant to decision-making. As a remedy, we propose a novel two-stage learning objective that retargets the CATE to balance CATE estimation error and decision performance. We then propose a neural method that optimizes an adaptively-smoothed approximation of our learning objective. Finally, we confirm the effectiveness of our method both empirically and theoretically. In sum, our work is the first to show how two-stage CATE estimators can be adapted for optimal decision-making.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
32 of 65 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 600
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 478
- 2015Doubly Robust Off-policy Value Evaluation for Reinforcement Learningcited by 339
- 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 332
- 2016Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learningcited by 286
- 2020Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representationscited by 155
- 2019Orthogonal Statistical Learningcited by 151
- 2017Fair Inference On Outcomescited by 144
- 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
- 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
- 2019Double Reinforcement Learning for Efficient Off-Policy Evaluation in Markov Decision Processescited by 119
20 more
- 2019Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learningcited by 75
- 2021On Inductive Biases for Heterogeneous Treatment Effect Estimationcited by 75
- 2024Causal machine learning for predicting treatment outcomescited by 74
- 2017Balanced Policy Evaluation and Learningcited by 52
- 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learningcited by 34
- 2019Intrinsically Efficient, Stable, and Bounded Off-Policy Evaluation for Reinforcement Learningcited by 28
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2019More Efficient Policy Learning via Optimal Retargetingcited by 23
- 2024Model-agnostic meta-learners for estimating heterogeneous treatment effects over timecited by 19
- 2019More Efficient Off-Policy Evaluation through Regularized Targeted Learningcited by 17
- 2023Reliable Off-Policy Learning for Dosage Combinationscited by 15
- 2023Fair Off-Policy Learning from Observational Datacited by 11
- 2020Efficient Policy Learning from Surrogate-Loss Classification Reductionscited by 10
- 2020Doubly Robust Off-Policy Value and Gradient Estimation for Deterministic Policiescited by 10
- 2020Regret Minimization for Causal Inference on Large Treatment Spacecited by 7
- 2023Fair and Robust Estimation of Heterogeneous Treatment Effects for Policy Learningcited by 6
- 2024Causal Machine Learning for Cost-Effective Allocation of Development Aidcited by 6
- 2023Data-Driven Allocation of Preventive Care With Application to Diabetes Mellitus Type IIcited by 5
- 2022Interpretable Off-Policy Learning via Hyperbox Searchcited by 3
- 2023Minimax optimal subgroup identificationcited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effectscited by 3
- 2026Aligning Data-Driven Predictors with Allocation: A Decision-Focused Approach to Survival Analysiscited by 2
- 2025GDR-learners: Orthogonal Learning of Generative Models for Potential Outcomescited by 1
- 2025Annotation-Assisted Learning of Treatment Policies From Multimodal Electronic Health Recordscited by 0
- 2025Reliable Selection of Heterogeneous Treatment Effect Estimatorscited by 0
- 2026Uncertainty-aware Causal Decision Making via Effect Bound Decompositioncited by 0
- 2026Should I stay or should I show? Learning to selectively disclose informationcited by 0
- 2026Learning Deployable Causal Action Geometry under Temporal Non-Stationaritycited by 0
- 2026Learning Deployable Causal Action Geometry under Temporal Non-Stationarity12 Oct 2026
- 2026Should I stay or should I show? Learning to selectively disclose information30 Sep 2026
- 2026Aligning Data-Driven Predictors with Allocation: A Decision-Focused Approach to Survival Analysis1 Jun 2026
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effects3 Feb 2026
- 2026Uncertainty-aware Causal Decision Making via Effect Bound Decomposition30 Jan 2026
- 2025Reliable Selection of Heterogeneous Treatment Effect Estimators23 Nov 2025
- 2025GDR-learners: Orthogonal Learning of Generative Models for Potential Outcomes26 Sep 2025
- 2025Annotation-Assisted Learning of Treatment Policies From Multimodal Electronic Health Records28 Jul 2025