Hyperbolic Random Forests
Not on the map. Why?
Abstract (arXiv)
Hyperbolic space is becoming a popular choice for representing data due to the hierarchical structure - whether implicit or explicit - of many real-world datasets. Along with it comes a need for algorithms capable of solving fundamental tasks, such as classification, in hyperbolic space. Recently, multiple papers have investigated hyperbolic alternatives to hyperplane-based classifiers, such as logistic regression and SVMs. While effective, these approaches struggle with more complex hierarchical data. We, therefore, propose to generalize the well-known random forests to hyperbolic space. We do this by redefining the notion of a split using horospheres. Since finding the globally optimal split is computationally intractable, we find candidate horospheres through a large-margin classifier. To make hyperbolic random forests work on multi-class data and imbalanced experiments, we furthermore outline a new method for combining classes based on their lowest common ancestor and a class-balanced version of the large-margin loss. Experiments on standard and new benchmarks show that our approach outperforms both conventional random forest algorithms and recent hyperbolic classifiers.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 37 of its 65 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
37 of 65 references.
References · 37
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
- 2018Hyperbolic Neural Networkscited by 402
- 2019Hyperbolic Graph Convolutional Neural Networkscited by 402
- 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 265
- 2019Hyperbolic Graph Neural Networkscited by 244
- 2019Hyperbolic Image Embeddingscited by 221
- 2018Hyperbolic Entailment Cones for Learning Hierarchical Embeddingscited by 162
- 2018Poincar'e GloVe: Hyperbolic Word Embeddingscited by 156
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 139
- 2023Hyperbolic Image-Text Representationscited by 136
- 2017Cooperative Game Theory Approaches for Network Partitioningcited by 135
25 more
- 2022Hyperbolic Image Segmentationcited by 102
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2020From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clusteringcited by 65
- 2017Neural Embeddings of Graphs in Hyperbolic Spacecited by 58
- 2020Differentiating through the Fr'echet Meancited by 53
- 2021Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphscited by 50
- 2021Learning the Predictability of the Futurecited by 49
- 2021HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projectionscited by 47
- 2018Large-Margin Classification in Hyperbolic Spacecited by 41
- 2021Hyperbolic Busemann Learning with Ideal Prototypescited by 41
- 2022Hyperbolic Graph Neural Networks: A Review of Methods and Applicationscited by 40
- 2022Learning Hierarchy Aware Features for Reducing Mistake Severitycited by 26
- 2023Poincar'e ResNetcited by 25
- 2021ARM-Net: Adaptive Relation Modeling Network for Structured Datacited by 24
- 2020Robust Large-Margin Learning in Hyperbolic Spacecited by 21
- 2021No Cost Likelihood Manipulation at Test Time for Making Better Mistakes in Deep Networkscited by 21
- 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
- 2022Fully-Connected Network on Noncompact Symmetric Space and Ridgelet Transform based on Helgason-Fourier Analysiscited by 14
- 2022FisheyeHDK: Hyperbolic Deformable Kernel Learning for Ultra-Wide Field-of-View Image Recognitioncited by 10
- 2021Highly Scalable and Provably Accurate Classification in Poincare Ballscited by 8
- 2023HMSN: Hyperbolic Self-Supervised Learning by Clustering with Ideal Prototypescited by 6
- 2020Hyperbolic Manifold Regressioncited by 5
- 2021Hyperbolic Disentangled Representation for Fine-Grained Aspect Extractioncited by 3
- 2018Enhancing Multi-Class Classification of Random Forest using Random Vector Functional Neural Network and Oblique Decision Surfacescited by 2
- 2022Provably Accurate and Scalable Linear Classifiers in Hyperbolic Spacescited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 3.
9 papers.
- 2023Fast hyperboloid decision tree algorithmscited by 7
- 2025Continual Hyperbolic Learning of Instances and Classescited by 5
- 2024Adversarial Attacks on Hyperbolic Networkscited by 3
- 2024Mixed-curvature decision trees and random forestscited by 2
- 2024On Probabilistic Pullback Metrics for Latent Hyperbolic Manifoldscited by 1
- 2025Busemann Functions in the Wasserstein Space: Existence, Closed-Forms, and Applications to Slicingcited by 1
- 2024Tempered Calculus for ML: Application to Hyperbolic Model Embeddingcited by 0
- 2024Mixed-Curvature Decision Trees and Random Forestscited by 0
- 2025Even Faster Hyperbolic Random Forests: A Beltrami-Klein Wrapper Approachcited by 0
- 2025Busemann Functions in the Wasserstein Space: Existence, Closed-Forms, and Applications to Slicing6 Oct 2025
- 2025Continual Hyperbolic Learning of Instances and Classes12 Jun 2025
- 2025Even Faster Hyperbolic Random Forests: A Beltrami-Klein Wrapper Approach4 Jun 2025
- 2024Adversarial Attacks on Hyperbolic Networks2 Dec 2024
- 2024On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds28 Oct 2024
- 2024Mixed-curvature decision trees and random forests3 Oct 2024
- 2024Mixed-Curvature Decision Trees and Random Forests7 Jun 2024
- 2024Tempered Calculus for ML: Application to Hyperbolic Model Embedding6 Feb 2024
- 2023Fast hyperboloid decision tree algorithms20 Oct 2023