# An Eager Splitting Strategy for Online Decision Trees

arXiv: https://arxiv.org/abs/2010.10935 · HTML: https://mlsanity.com/paper/2010.10935/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Oct 2020.

## Built on by (most cited first, 5 of 5)

- [Standardized Evaluation of Machine Learning Methods for Evolving Data Streams](https://mlsanity.com/paper/2204.13625/) (2022)
- [Fully-Dynamic Decision Trees](https://mlsanity.com/paper/2212.00778/) (2022)
- [Fully-Dynamic Approximate Decision Trees With Worst-Case Update Time Guarantees](https://mlsanity.com/paper/2302.03994/) (2023)
- [Approximating splits for decision trees quickly in sparse data streams](https://mlsanity.com/paper/2601.12525/) (2026)
- [Hoeffding adaptive splitting trees for data stream classification with concept drift and ensemble learning](https://mlsanity.com/paper/2608.16659/) (2026)

## Abstract (arXiv)

Decision tree ensembles are widely used in practice. In this work, we study in ensemble settings the effectiveness of replacing the split strategy for the state-of-the-art online tree learner, Hoeffding Tree, with a rigorous but more eager splitting strategy that we had previously published as Hoeffding AnyTime Tree. Hoeffding AnyTime Tree (HATT), uses the Hoeffding Test to determine whether the current best candidate split is superior to the current split, with the possibility of revision, while Hoeffding Tree aims to determine whether the top candidate is better than the second best and if a test is selected, fixes it for all posterity. HATT converges to the ideal batch tree while Hoeffding Tree does not. We find that HATT is an efficacious base learner for online bagging and online boosting ensembles. On UCI and synthetic streams, HATT as a base learner outperforms HT within a 0.05 significance level for the majority of tested ensembles on what we believe is the largest and most comprehensive set of testbenches in the online learning literature. Our results indicate that HATT is a superior alternative to Hoeffding Tree in a large number of ensemble settings.