Learning Optimal Prescriptive Trees from Observational Data
Not on the map. Why?
Abstract (arXiv)
We consider the problem of learning an optimal prescriptive tree (i.e., an interpretable treatment assignment policy in the form of a binary tree) of moderate depth, from observational data. This problem arises in numerous socially important domains such as public health and personalized medicine, where interpretable and data-driven interventions are sought based on data gathered in deployment -- through passive collection of data -- rather than from randomized trials. We propose a method for learning optimal prescriptive trees using mixed-integer optimization (MIO) technology. We show that under mild conditions our method is asymptotically exact in the sense that it converges to an optimal out-of-sample treatment assignment policy as the number of historical data samples tends to infinity. Contrary to existing literature, our approach: 1) does not require data to be randomized, 2) does not impose stringent assumptions on the learned trees, and 3) has the ability to model domain specific constraints. Through extensive computational experiments, we demonstrate that our asymptotic guarantees translate to significant performance improvements in finite samples, as well as showcase our uniquely flexible modeling power by incorporating budget and fairness constraints.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 21 of its 78 references that are in the map. First posted on arXiv 31 Aug 2021.
Builds on
21 of 78 references.
References · 21
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 254
- 2019Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Makingcited by 75
- 2018Offline Multi-Action Policy Learning: Generalization and Optimizationcited by 64
- 2020Decision Trees for Decision-Making under the Predict-then-Optimize Frameworkcited by 52
- 2017Balanced Policy Evaluation and Learningcited by 51
- 2020The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verificationcited by 50
- 2017Some methods for heterogeneous treatment effect estimation in high-dimensionscited by 48
- 2020Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimizationcited by 45
- 2017Sparse High-Dimensional Regression: Exact Scalable Algorithms and Phase Transitionscited by 43
9 more
- 2016Recursive Partitioning for Personalization using Observational Datacited by 28
- 2021Strong Optimal Classification Treescited by 27
- 2017Optimization of Tree Ensemblescited by 26
- 2017The ALAMO approach to machine learningcited by 18
- 2018Combinatorial Attacks on Binarized Neural Networkscited by 11
- 2017Behavioral Analytics for Myopic Agentscited by 9
- 2017Spectral Algorithms for Computing Fair Support Vector Machinescited by 9
- 2016Optimal Generalized Decision Trees via Integer Programmingcited by 7
- 2014Optimal Multilevel Matching in Clustered Observational Studies: A Case Study of the Effectiveness of Private Schools Under a Large-Scale Voucher Systemcited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 4; 2025: 0; 2026: 1.
10 papers.
- 2022Learning Optimal Fair Classification Trees: Trade-offs Between Interpretability, Fairness, and Accuracycited by 15
- 2024Optimal or Greedy Decision Trees? Revisiting their Objectives, Tuning, and Performancecited by 7
- 2022Learning Resource Allocation Policies from Observational Data with an Application to Homeless Services Deliverycited by 5
- 2021Interpretable Personalized Experimentationcited by 3
- 2023Learning Optimal Classification Trees Robust to Distribution Shiftscited by 1
- 2023Learning Fair Policies for Multi-stage Selection Problems from Observational Datacited by 1
- 2024Feature-Based Interpretable Surrogates for Optimizationcited by 1
- 2024PresAIse, A Prescriptive AI Solution for Enterprisescited by 0
- 2024Applications of 0-1 Neural Networks in Prescription and Predictioncited by 0
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Datacited by 0
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Data15 Jul 2026
- 2024Optimal or Greedy Decision Trees? Revisiting their Objectives, Tuning, and Performance19 Sep 2024
- 2024Feature-Based Interpretable Surrogates for Optimization3 Sep 2024
- 2024Applications of 0-1 Neural Networks in Prescription and Prediction29 Feb 2024
- 2024PresAIse, A Prescriptive AI Solution for Enterprises3 Feb 2024
- 2023Learning Fair Policies for Multi-stage Selection Problems from Observational Data20 Dec 2023
- 2023Learning Optimal Classification Trees Robust to Distribution Shifts26 Oct 2023
- 2022Learning Resource Allocation Policies from Observational Data with an Application to Homeless Services Delivery25 Jan 2022
- 2022Learning Optimal Fair Classification Trees: Trade-offs Between Interpretability, Fairness, and Accuracy24 Jan 2022
- 2021Interpretable Personalized Experimentation5 Nov 2021