# Tree-Based Dynamic Classifier Chains

arXiv: https://arxiv.org/abs/2112.06672 · HTML: https://mlsanity.com/paper/2112.06672/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 57 references that are in the map.
- First posted on arXiv 13 Dec 2021.

## Builds on (most cited first, 10 of 10)

- [XGBoost: A Scalable Tree Boosting System](https://mlsanity.com/paper/1603.02754/) (2016)
- [Comprehensive Comparative Study of Multi-Label Classification Methods](https://mlsanity.com/paper/2102.07113/) (2021)
- [Large-scale Multi-label Text Classification - Revisiting Neural Networks](https://mlsanity.com/paper/1312.5419/) (2013)
- [Classifier Chains: A Review and Perspectives](https://mlsanity.com/paper/1912.13405/) (2019)
- [GBDT-MO: Gradient Boosted Decision Trees for Multiple Outputs](https://mlsanity.com/paper/1909.04373/) (2019)
- [Multi-Target Prediction: A Unifying View on Problems and Methods](https://mlsanity.com/paper/1809.02352/) (2018)
- [Learning Gradient Boosted Multi-label Classification Rules](https://mlsanity.com/paper/2006.13346/) (2020)
- [On Aggregation in Ensembles of Multilabel Classifiers](https://mlsanity.com/paper/2006.11916/) (2020)
- [Dynamic classifier chains for multi-label learning](https://mlsanity.com/paper/1710.07491/) (2017)
- [Extreme Gradient Boosted Multi-label Trees for Dynamic Classifier Chains](https://mlsanity.com/paper/2006.08094/) (2020)

## Built on by (most cited first, 2 of 2)

- [Label Cluster Chains for Multi-Label Classification](https://mlsanity.com/paper/2411.00514/) (2024)
- [Semantic F1 Scores: Fair Evaluation Under Fuzzy Class Boundaries](https://mlsanity.com/paper/2509.21633/) (2025)

## Abstract (arXiv)

Classifier chains are an effective technique for modeling label dependencies in multi-label classification. However, the method requires a fixed, static order of the labels. While in theory, any order is sufficient, in practice, this order has a substantial impact on the quality of the final prediction. Dynamic classifier chains denote the idea that for each instance to classify, the order in which the labels are predicted is dynamically chosen. The complexity of a naive implementation of such an approach is prohibitive, because it would require to train a sequence of classifiers for every possible permutation of the labels. To tackle this problem efficiently, we propose a new approach based on random decision trees which can dynamically select the label ordering for each prediction. We show empirically that a dynamic selection of the next label improves over the use of a static ordering under an otherwise unchanged random decision tree model. % and experimental environment. In addition, we also demonstrate an alternative approach based on extreme gradient boosted trees, which allows for a more target-oriented training of dynamic classifier chains. Our results show that this variant outperforms random decision trees and other tree-based multi-label classification methods. More importantly, the dynamic selection strategy allows to considerably speed up training and prediction.
