Distributional Random Forests: Heterogeneity Adjustment and Multivariate Distributional Regression
Not on the map. Why?
Abstract (arXiv)
Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data, which can also be used for targets other than the original mean estimation. We propose a novel forest construction for multivariate responses based on their joint conditional distribution, independent of the estimation target and the data model. It uses a new splitting criterion based on the MMD distributional metric, which is suitable for detecting heterogeneity in multivariate distributions. The induced weights define an estimate of the full conditional distribution, which in turn can be used for arbitrary and potentially complicated targets of interest. The method is very versatile and convenient to use, as we illustrate on a wide range of examples. The code is available as Python and R packages drf.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 5; 2023: 6; 2024: 8; 2025: 8; 2026: 9.
36 papers.
Sort:
By area:
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learningcited by 34
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discoverycited by 18
- 2022Characterization and Greedy Learning of Gaussian Structural Causal Models under Unknown Interventionscited by 12
- 2024Regression Trees for Fast and Adaptive Prediction Intervalscited by 11
- 2023An Efficient Doubly-Robust Test for the Kernel Treatment Effectcited by 10
- 2022Aggregating distribution forecasts from deep ensemblescited by 5
- 2023Confidence and Uncertainty Assessment for Distributional Random Forestscited by 5
- 2024Treeffuser: Probabilistic Predictions via Conditional Diffusions with Gradient-Boosted Treescited by 5
- 2022Distributional regression and its evaluation with the CRPS: Bounds and convergence of the minimax riskcited by 3
- 2024Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processescited by 3
- 2024Model Free Prediction with Uncertainty Assessmentcited by 3
24 more
- 2024Online Distributional Regressioncited by 3
- 2025Multivariate Latent Recalibration for Conditional Normalizing Flowscited by 3
- 2023MMD-based Variable Importance for Distributional Random Forestcited by 2
- 2026The Generalised Kernel Covariance Measurecited by 2
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forestscited by 1
- 2023A new methodology to predict the oncotype scores based on clinico-pathological data with similar tumor profilescited by 0
- 2023Generalized Random Forests using Fixed-Point Treescited by 0
- 2024Simplifying Random Forests' Probabilistic Forecastscited by 0
- 2024Scoring rule nets: beyond mean target prediction in multivariate regressioncited by 0
- 2024Interaction Testing in Variation Analysiscited by 0
- 2025Risk Bounds For Distributional Regressioncited by 0
- 2025LILI clustering algorithm: Limit Inferior Leaf Interval Integrated into Causal Forest for Causal Interferencecited by 0
- 2025Generative Regression with IQ-BARTcited by 0
- 2025Transforming Conditional Density Estimation Into a Single Nonparametric Regression Taskcited by 0
- 2025Forests of Uncertaint(r)ees: Using tree-based ensembles to estimate probability distributions of future conflictcited by 0
- 2025Distributional Random Forests for Complex Survey Designscited by 0
- 2026Reliable Real-Time Value at Risk Estimation via Quantile Regression Forest with Conformal Calibrationcited by 0
- 2026Nonparametric Distribution Regression Re-calibrationcited by 0
- 2026Distributional Split Criteria for Random Forests: Extensions, Shrinkage, and the Robustness of Mean Splittingcited by 0
- 2026Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensionscited by 0
- 2026Conditioning Tree-Based Diffusions and Flows for Probabilistic Tabular Regressioncited by 0
- 2026Scaling-Score Conformal Prediction for Multi-Target Regressioncited by 0
- 2026Wasserstein Causal Forests for Distribution-Valued Outcomescited by 0
- 2026Generalized Engression Modelscited by 0
- 2026Generalized Engression Models1 Oct 2026
- 2026Wasserstein Causal Forests for Distribution-Valued Outcomes27 Sep 2026
- 2026Scaling-Score Conformal Prediction for Multi-Target Regression15 Sep 2026
- 2026Conditioning Tree-Based Diffusions and Flows for Probabilistic Tabular Regression30 Jul 2026
- 2026Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions29 Jul 2026
- 2026Distributional Split Criteria for Random Forests: Extensions, Shrinkage, and the Robustness of Mean Splitting26 Jul 2026
- 2026The Generalised Kernel Covariance Measure4 Apr 2026
- 2026Nonparametric Distribution Regression Re-calibration13 Feb 2026
- 2026Reliable Real-Time Value at Risk Estimation via Quantile Regression Forest with Conformal Calibration2 Feb 2026
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forests18 Dec 2025
- 2025Distributional Random Forests for Complex Survey Designs9 Dec 2025
- 2025Forests of Uncertaint(r)ees: Using tree-based ensembles to estimate probability distributions of future conflict5 Dec 2025
24 more
- 2025Transforming Conditional Density Estimation Into a Single Nonparametric Regression Task23 Nov 2025
- 2025Generative Regression with IQ-BART5 Jul 2025
- 2025LILI clustering algorithm: Limit Inferior Leaf Interval Integrated into Causal Forest for Causal Interference4 Jul 2025
- 2025Multivariate Latent Recalibration for Conditional Normalizing Flows22 May 2025
- 2025Risk Bounds For Distributional Regression14 May 2025
- 2024Interaction Testing in Variation Analysis13 Nov 2024
- 2024Scoring rule nets: beyond mean target prediction in multivariate regression22 Sep 2024
- 2024Simplifying Random Forests' Probabilistic Forecasts22 Aug 2024
- 2024Online Distributional Regression26 Jun 2024
- 2024Treeffuser: Probabilistic Predictions via Conditional Diffusions with Gradient-Boosted Trees11 Jun 2024
- 2024Model Free Prediction with Uncertainty Assessment21 May 2024
- 2024Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes29 Mar 2024
- 2024Regression Trees for Fast and Adaptive Prediction Intervals12 Feb 2024
- 2023MMD-based Variable Importance for Distributional Random Forest18 Oct 2023
- 2023Generalized Random Forests using Fixed-Point Trees20 Jun 2023
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discovery19 Jun 2023
- 2023An Efficient Doubly-Robust Test for the Kernel Treatment Effect26 Apr 2023
- 2023A new methodology to predict the oncotype scores based on clinico-pathological data with similar tumor profiles13 Mar 2023
- 2023Confidence and Uncertainty Assessment for Distributional Random Forests11 Feb 2023
- 2022Characterization and Greedy Learning of Gaussian Structural Causal Models under Unknown Interventions27 Nov 2022
- 2022Adversarial random forests for density estimation and generative modeling19 May 2022
- 2022Distributional regression and its evaluation with the CRPS: Bounds and convergence of the minimax risk9 May 2022
- 2022Aggregating distribution forecasts from deep ensembles5 Apr 2022
- 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learning19 Feb 2022
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2022Doubly Robust Distributionally Robust Off-Policy Evaluation and Learningcited by 34
- 2023textttcausalAssembly: Generating Realistic Production Data for Benchmarking Causal Discoverycited by 18
- 2022Characterization and Greedy Learning of Gaussian Structural Causal Models under Unknown Interventionscited by 12
- 2024Regression Trees for Fast and Adaptive Prediction Intervalscited by 11
- 2023An Efficient Doubly-Robust Test for the Kernel Treatment Effectcited by 10
- 2022Aggregating distribution forecasts from deep ensemblescited by 5
- 2023Confidence and Uncertainty Assessment for Distributional Random Forestscited by 5
- 2022Distributional regression and its evaluation with the CRPS: Bounds and convergence of the minimax riskcited by 3
- 2024Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processescited by 3
- 2024Online Distributional Regressioncited by 3
- 2025Multivariate Latent Recalibration for Conditional Normalizing Flowscited by 3
12 most cited of 33 All 33 (JSON)
- 2026Generalized Engression Models1 Oct 2026
- 2026Wasserstein Causal Forests for Distribution-Valued Outcomes27 Sep 2026
- 2026Scaling-Score Conformal Prediction for Multi-Target Regression15 Sep 2026
- 2026Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions29 Jul 2026
- 2026Distributional Split Criteria for Random Forests: Extensions, Shrinkage, and the Robustness of Mean Splitting26 Jul 2026
- 2026The Generalised Kernel Covariance Measure4 Apr 2026
- 2026Nonparametric Distribution Regression Re-calibration13 Feb 2026
- 2026Reliable Real-Time Value at Risk Estimation via Quantile Regression Forest with Conformal Calibration2 Feb 2026
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forests18 Dec 2025
- 2025Distributional Random Forests for Complex Survey Designs9 Dec 2025
- 2025Forests of Uncertaint(r)ees: Using tree-based ensembles to estimate probability distributions of future conflict5 Dec 2025
- 2025Transforming Conditional Density Estimation Into a Single Nonparametric Regression Task23 Nov 2025
12 newest of 33 All 33 (JSON)