mlsanityData to 14 Oct 2026

Efficient Decision Trees for Tensor Regressions

arXiv 2408.01926 ↗First posted 4 Aug 2024cs.LG stat.ME stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

We proposed the tensor-input tree (TT) method for scalar-on-tensor and tensor-on-tensor regression problems. We first address scalar-on-tensor problem by proposing scalar-output regression tree models whose input variable are tensors (i.e., multi-way arrays). We devised and implemented fast randomized and deterministic algorithms for efficient fitting of scalar-on-tensor trees, making TT competitive against tensor-input GP models. Based on scalar-on-tensor tree models, we extend our method to tensor-on-tensor problems using additive tree ensemble approaches. Theoretical justification and extensive experiments on real and synthetic datasets are provided to illustrate the performance of TT.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 69 references that are in the map. First posted on arXiv 4 Aug 2024.

Builds on

23 of 69 references.

References · 23

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2016TensorLy: Tensor Learning in Pythoncited by 104
  3. 2023Randomized Numerical Linear Algebra : A Perspective on the Field With an Eye to Softwarecited by 38
  4. 2017Bayesian Regression Tree Ensembles that Adapt to Smoothness and Sparsitycited by 34
  5. 2019Randomization as Regularization: A Degrees of Freedom Explanation for Random Forest Successcited by 30
  6. 2021Large Scale Prediction with Decision Treescited by 28
  7. 2013Tucker Tensor Regression and Neuroimaging Analysiscited by 26
  8. 2017Tensor-on-tensor regressioncited by 22
  9. 2015Bayesian Tensor Regressioncited by 21
  10. 2015Parsimonious Tensor Response Regressioncited by 20
  11. 2022Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplaycited by 15
  12. 2017Scalable Tucker Factorization for Sparse Tensors - Algorithms and Discoveriescited by 14
11 more
  1. 2018A novel approach for fusion of heterogeneous sources of datacited by 14
  2. 2017Tensor Regression Meets Gaussian Processescited by 12
  3. 2021Non-smooth Bayesian Optimization in Tuning Problemscited by 8
  4. 2023Medoid splits for efficient random forests in metric spacescited by 7
  5. 2023Sharded Bayesian Additive Regression Treescited by 6
  6. 2022Hybrid Parameter Search and Dynamic Model Selection for Mixed-Variable Bayesian Optimizationcited by 4
  7. 2022Bayesian Tensor-on-Tensor Regression with Efficient Computationcited by 3
  8. 2019Soft Tensor Regressioncited by 2
  9. 2023Tensor Gaussian Process with Contraction for Multi-Channel Imaging Analysiscited by 2
  10. 2023Bayesian Methods in Tensor Analysiscited by 2
  11. 2023Contrastive inverse regression for dimension reductioncited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.