mlsanityData to 14 Oct 2026

Treatment Effect Estimation for Optimal Decision-Making

arXiv 2505.13092 ↗First posted 19 May 2025cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Decision-making across various fields, such as medicine, heavily relies on conditional average treatment effects (CATEs). Practitioners commonly make decisions by checking whether the estimated CATE is positive, even though the decision-making performance of modern CATE estimators is poorly understood from a theoretical perspective. In this paper, we study optimal decision-making based on two-stage CATE estimators (e.g., DR-learner), which are considered state-of-the-art and widely used in practice. We prove that, while such estimators may be optimal for estimating CATE, they can be suboptimal when used for decision-making. Intuitively, this occurs because such estimators prioritize CATE accuracy in regions far away from the decision boundary, which is ultimately irrelevant to decision-making. As a remedy, we propose a novel two-stage learning objective that retargets the CATE to balance CATE estimation error and decision performance. We then propose a neural method that optimizes an adaptively-smoothed approximation of our learning objective. Finally, we confirm the effectiveness of our method both empirically and theoretically. In sum, our work is the first to show how two-stage CATE estimators can be adapted for optimal decision-making.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

32 of 65 references.

References · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 600
  3. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 478
  4. 2015Doubly Robust Off-policy Value Evaluation for Reinforcement Learningcited by 339
  5. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 332
  6. 2016Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learningcited by 286
  7. 2020Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representationscited by 155
  8. 2019Orthogonal Statistical Learningcited by 151
  9. 2017Fair Inference On Outcomescited by 144
  10. 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
  11. 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
  12. 2019Double Reinforcement Learning for Efficient Off-Policy Evaluation in Markov Decision Processescited by 119
20 more
  1. 2019Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learningcited by 75
  2. 2021On Inductive Biases for Heterogeneous Treatment Effect Estimationcited by 75
  3. 2024Causal machine learning for predicting treatment outcomescited by 74
  4. 2017Balanced Policy Evaluation and Learningcited by 52
  5. 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learningcited by 34
  6. 2019Intrinsically Efficient, Stable, and Bounded Off-Policy Evaluation for Reinforcement Learningcited by 28
  7. 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
  8. 2019More Efficient Policy Learning via Optimal Retargetingcited by 23
  9. 2024Model-agnostic meta-learners for estimating heterogeneous treatment effects over timecited by 19
  10. 2019More Efficient Off-Policy Evaluation through Regularized Targeted Learningcited by 17
  11. 2023Reliable Off-Policy Learning for Dosage Combinationscited by 15
  12. 2023Fair Off-Policy Learning from Observational Datacited by 11
  13. 2020Efficient Policy Learning from Surrogate-Loss Classification Reductionscited by 10
  14. 2020Doubly Robust Off-Policy Value and Gradient Estimation for Deterministic Policiescited by 10
  15. 2020Regret Minimization for Causal Inference on Large Treatment Spacecited by 7
  16. 2023Fair and Robust Estimation of Heterogeneous Treatment Effects for Policy Learningcited by 6
  17. 2024Causal Machine Learning for Cost-Effective Allocation of Development Aidcited by 6
  18. 2023Data-Driven Allocation of Preventive Care With Application to Diabetes Mellitus Type IIcited by 5
  19. 2022Interpretable Off-Policy Learning via Hyperbox Searchcited by 3
  20. 2023Minimax optimal subgroup identificationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.