# A Tree-based Model Averaging Approach for Personalized Treatment Effect Estimation from Heterogeneous Data Sources

arXiv: https://arxiv.org/abs/2103.06261 · HTML: https://mlsanity.com/paper/2103.06261/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 92 references that are in the map.
- First posted on arXiv 10 Mar 2021.

## Builds on (most cited first, 25 of 25)

- [Communication-Efficient Learning of Deep Networks from Decentralized Data](https://mlsanity.com/paper/1602.05629/) (2016)
- [Advances and Open Problems in Federated Learning](https://mlsanity.com/paper/1912.04977/) (2019)
- [Federated Learning: Challenges, Methods, and Future Directions](https://mlsanity.com/paper/1908.07873/) (2019)
- [Federated Learning with Non-IID Data](https://mlsanity.com/paper/1806.00582/) (2018)
- [Federated Multi-Task Learning](https://mlsanity.com/paper/1705.10467/) (2017)
- [Estimation and Inference of Heterogeneous Treatment Effects using Random Forests](https://mlsanity.com/paper/1510.04342/) (2015)
- [Federated Learning for Mobile Keyboard Prediction](https://mlsanity.com/paper/1811.03604/) (2018)
- [Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learning](https://mlsanity.com/paper/1706.03461/) (2017)
- [Federated Machine Learning: Concept and Applications](https://mlsanity.com/paper/1902.04885/) (2019)
- [The Effectiveness of Data Augmentation in Image Classification using Deep Learning](https://mlsanity.com/paper/1712.04621/) (2017)
- [Quasi-Oracle Estimation of Heterogeneous Treatment Effects](https://mlsanity.com/paper/1712.04912/) (2017)
- [Generalized Random Forests](https://mlsanity.com/paper/1610.01271/) (2016)
- [Recursive Partitioning for Heterogeneous Causal Effects](https://mlsanity.com/paper/1504.01132/) (2015)
- [External Validity: From Do-Calculus to Transportability Across Populations](https://mlsanity.com/paper/1503.01603/) (2015)
- [Causal inference methods for combining randomized trials and observational studies: a review](https://mlsanity.com/paper/2011.08047/) (2020)
- [Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects](https://mlsanity.com/paper/1706.09523/) (2017)
- [Using stacking to average Bayesian predictive distributions](https://mlsanity.com/paper/1704.02030/) (2017)
- [A Review of Generalizability and Transportability](https://mlsanity.com/paper/2102.11904/) (2021)
- [Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals](https://mlsanity.com/paper/1709.04589/) (2017)
- [Elastic Integrative Analysis of Randomized Trial and Real-World Data for Treatment Heterogeneity Estimation](https://mlsanity.com/paper/2005.10579/) (2020)
- [A concave pairwise fusion approach to subgroup analysis](https://mlsanity.com/paper/1508.07045/) (2015)
- [The Sylvester Graphical Lasso (SyGlasso)](https://mlsanity.com/paper/2002.00288/) (2020)
- [Individualized Multi-directional Variable Selection](https://mlsanity.com/paper/1709.05062/) (2017)
- [Propensity score prediction for electronic healthcare databases using Super Learner and High-dimensional Propensity Score Methods](https://mlsanity.com/paper/1703.02236/) (2017)
- [Dynamically borrowing strength from another study through shrinkage estimation](https://mlsanity.com/paper/1806.01015/) (2018)

## Built on by (most cited first, 14 of 14)

- [Federated Learning for Cyber Physical Systems: A Comprehensive Survey](https://mlsanity.com/paper/2505.04873/) (2025)
- [Minimax Regret Estimation for Generalizing Heterogeneous Treatment Effects with Multisite Data](https://mlsanity.com/paper/2412.11136/) (2024)
- [Comparison of Methods that Combine Multiple Randomized Trials to Estimate Heterogeneous Treatment Effects](https://mlsanity.com/paper/2303.16299/) (2023)
- [Multi-Study R-Learner for Estimating Heterogeneous Treatment Effects Across Studies Using Statistical Machine Learning](https://mlsanity.com/paper/2306.01086/) (2023)
- [RISE: Robust Individualized Decision Learning with Sensitive Variables](https://mlsanity.com/paper/2211.06569/) (2022)
- [Federated Causal Inference: Multi-Study ATE Estimation beyond Meta-Analysis](https://mlsanity.com/paper/2410.16870/) (2024)
- [Beyond Single-Feature Importance with ICECREAM](https://mlsanity.com/paper/2307.09779/) (2023)
- [Federated Learning for Estimating Heterogeneous Treatment Effects](https://mlsanity.com/paper/2402.17705/) (2024)
- [Interpretable and Scalable Graphical Models for Complex Spatio-temporal Processes](https://mlsanity.com/paper/2301.06021/) (2023)
- [Estimation of conditional average treatment effects on distributed confidential data](https://mlsanity.com/paper/2402.02672/) (2024)
- [Federated Causal Inference in Healthcare: Methods, Challenges, and Applications](https://mlsanity.com/paper/2505.02238/) (2025)
- [Early Risk Stratification of Dosing Errors in Clinical Trials Using Machine Learning](https://mlsanity.com/paper/2602.22285/) (2026)
- [Meta-analysis of individualized treatment rules via sign-coherency](https://mlsanity.com/paper/2211.15476/) (2022)
- [Orthogonal Learner for Estimating Heterogeneous Long-Term Treatment Effects](https://mlsanity.com/paper/2604.00915/) (2026)

## Abstract (arXiv)

Accurately estimating personalized treatment effects within a study site (e.g., a hospital) has been challenging due to limited sample size. Furthermore, privacy considerations and lack of resources prevent a site from leveraging subject-level data from other sites. We propose a tree-based model averaging approach to improve the estimation accuracy of conditional average treatment effects (CATE) at a target site by leveraging models derived from other potentially heterogeneous sites, without them sharing subject-level data. To our best knowledge, there is no established model averaging approach for distributed data with a focus on improving the estimation of treatment effects. Specifically, under distributed data networks, our framework provides an interpretable tree-based ensemble of CATE estimators that joins models across study sites, while actively modeling the heterogeneity in data sources through site partitioning. The performance of this approach is demonstrated by a real-world study of the causal effects of oxygen therapy on hospital survival rate and backed up by comprehensive simulation results.
