mlsanityData to 7 Oct 2026

Adapting tree-based multiple imputation methods for multi-level data? A simulation study

arXiv 2401.14161 ↗First posted 25 Jan 2024stat.AP stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

When data have a hierarchical structure, such as students nested within classrooms, ignoring dependencies between observations can compromise the validity of imputation procedures. Standard tree-based imputation methods implicitly assume independence between observations, limiting their applicability in multilevel data settings. Although Multivariate Imputation by Chained Equations (MICE) is widely used for hierarchical data, it has limitations, including sensitivity to model specification and computational complexity. Alternative tree-based approaches have shown promise for individual-level data, but remain largely unexplored for hierarchical contexts. In this simulation study, we systematically evaluate the performance of novel tree-based methods--Chained Random Forests and Extreme Gradient Boosting (mixgb)--explicitly adapted for multi-level data by incorporating dummy variables indicating cluster membership. We compare these tree-based methods and their adapted versions with traditional MICE imputation in terms of coefficient estimation bias, type I error rates and statistical power, under different cluster sizes, missingness mechanisms and missingness rates, using both random intercept and random slope data generation models. The results show that MICE provides robust and accurate inference for level 2 variables, especially at low missingness rates. However, the adapted boosting approach (mixgb with cluster dummies) consistently outperforms other methods for Level-1 variables at higher missingness rates (30%, 50%). For level 2 variables, while MICE retains better power at moderate missingness (30%), adapted boosting becomes superior at high missingness (50%), regardless of the missingness mechanism or cluster size. These findings highlight the potential of appropriately adapted tree-based imputation methods as effective alternatives to conventional MICE in multilevel data analyses.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 82 references that are in the map. First posted on arXiv 25 Jan 2024.

Builds on

8 of 82 references.

References · 8

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2015ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and Rcited by 171
  3. 2017Using simulation studies to evaluate statistical methodscited by 47
  4. 2017To tune or not to tune the number of trees in random forest?cited by 33
  5. 2017Random Forest Missing Data Algorithmscited by 23
  6. 2017Multiple imputation for multilevel data with continuous and binary variablescited by 4
  7. 2021Multiple Imputation Through XGBoostcited by 4
  8. 2024Evaluating tree-based imputation methods as an alternative to MICE PMM for drawing inference in empirical studiescited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.