mlsanityData to 7 Oct 2026

Learning Optimal Prescriptive Trees from Observational Data

arXiv 2108.13628 ↗First posted 31 Aug 2021cs.LG cs.CY stat.MLcited by 10

Not on the map. Why?

Abstract (arXiv)

We consider the problem of learning an optimal prescriptive tree (i.e., an interpretable treatment assignment policy in the form of a binary tree) of moderate depth, from observational data. This problem arises in numerous socially important domains such as public health and personalized medicine, where interpretable and data-driven interventions are sought based on data gathered in deployment -- through passive collection of data -- rather than from randomized trials. We propose a method for learning optimal prescriptive trees using mixed-integer optimization (MIO) technology. We show that under mild conditions our method is asymptotically exact in the sense that it converges to an optimal out-of-sample treatment assignment policy as the number of historical data samples tends to infinity. Contrary to existing literature, our approach: 1) does not require data to be randomized, 2) does not impose stringent assumptions on the learned trees, and 3) has the ability to model domain specific constraints. Through extensive computational experiments, we demonstrate that our asymptotic guarantees translate to significant performance improvements in finite samples, as well as showcase our uniquely flexible modeling power by incorporating budget and fairness constraints.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 21 of its 78 references that are in the map. First posted on arXiv 31 Aug 2021.

Builds on

21 of 78 references.

References · 21

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  3. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  4. 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 254
  5. 2019Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Makingcited by 75
  6. 2018Offline Multi-Action Policy Learning: Generalization and Optimizationcited by 64
  7. 2020Decision Trees for Decision-Making under the Predict-then-Optimize Frameworkcited by 52
  8. 2017Balanced Policy Evaluation and Learningcited by 51
  9. 2020The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verificationcited by 50
  10. 2017Some methods for heterogeneous treatment effect estimation in high-dimensionscited by 48
  11. 2020Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimizationcited by 45
  12. 2017Sparse High-Dimensional Regression: Exact Scalable Algorithms and Phase Transitionscited by 43
9 more
  1. 2016Recursive Partitioning for Personalization using Observational Datacited by 28
  2. 2021Strong Optimal Classification Treescited by 27
  3. 2017Optimization of Tree Ensemblescited by 26
  4. 2017The ALAMO approach to machine learningcited by 18
  5. 2018Combinatorial Attacks on Binarized Neural Networkscited by 11
  6. 2017Behavioral Analytics for Myopic Agentscited by 9
  7. 2017Spectral Algorithms for Computing Fair Support Vector Machinescited by 9
  8. 2016Optimal Generalized Decision Trees via Integer Programmingcited by 7
  9. 2014Optimal Multilevel Matching in Clustered Observational Studies: A Case Study of the Effectiveness of Private Schools Under a Large-Scale Voucher Systemcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 4; 2025: 0; 2026: 1.

10 papers.