# Deep tree-ensembles for multi-output prediction

arXiv: https://arxiv.org/abs/2011.02829 · HTML: https://mlsanity.com/paper/2011.02829/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Nov 2020.

## Built on by (most cited first, 4 of 4)

- [Volume-Sorted Prediction Set: Efficient Conformal Prediction for Multi-Target Regression](https://mlsanity.com/paper/2503.02205/) (2025)
- [From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approach](https://mlsanity.com/paper/2207.11742/) (2022)
- [Condensed Gradient Boosting](https://mlsanity.com/paper/2211.14599/) (2022)
- [Gated recurrent units and temporal convolutional network for multilabel classification](https://mlsanity.com/paper/2110.04414/) (2021)

## Abstract (arXiv)

Recently, deep neural networks have expanded the state-of-art in various scientific fields and provided solutions to long standing problems across multiple application domains. Nevertheless, they also suffer from weaknesses since their optimal performance depends on massive amounts of training data and the tuning of an extended number of parameters. As a countermeasure, some deep-forest methods have been recently proposed, as efficient and low-scale solutions. Despite that, these approaches simply employ label classification probabilities as induced features and primarily focus on traditional classification and regression tasks, leaving multi-output prediction under-explored. Moreover, recent work has demonstrated that tree-embeddings are highly representative, especially in structured output prediction. In this direction, we propose a novel deep tree-ensemble (DTE) model, where every layer enriches the original feature set with a representation learning component based on tree-embeddings. In this paper, we specifically focus on two structured output prediction tasks, namely multi-label classification and multi-target regression. We conducted experiments using multiple benchmark datasets and the obtained results confirm that our method provides superior results to state-of-the-art methods in both tasks.