# Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations

arXiv: https://arxiv.org/abs/2012.01644 · HTML: https://mlsanity.com/paper/2012.01644/

## Key facts

- Cited by 24 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Dec 2020.

## Built on by (most cited first, 24 of 24)

- [Hyperbolic Deep Learning in Computer Vision: A Survey](https://mlsanity.com/paper/2305.06611/) (2023)
- [Fully Hyperbolic Convolutional Neural Networks for Computer Vision](https://mlsanity.com/paper/2303.15919/) (2023)
- [Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Space](https://mlsanity.com/paper/2407.01290/) (2024)
- [Poincar'e ResNet](https://mlsanity.com/paper/2303.14027/) (2023)
- [Hyperbolic Representation Learning: Revisiting and Advancing](https://mlsanity.com/paper/2306.09118/) (2023)
- [Rethinking the compositionality of point clouds through regularization in the hyperbolic space](https://mlsanity.com/paper/2209.10318/) (2022)
- [kHGCN: Tree-likeness Modeling via Continuous and Discrete Curvature Learning](https://mlsanity.com/paper/2212.01793/) (2022)
- [Flattening the Parent Bias: Hierarchical Semantic Segmentation in the Poincar'e Ball](https://mlsanity.com/paper/2404.03778/) (2024)
- [Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels](https://mlsanity.com/paper/2311.11019/) (2023)
- [Learning Visual Hierarchies in Hyperbolic Space for Image Retrieval](https://mlsanity.com/paper/2411.17490/) (2024)
- [Leveraging Hyperbolic Embeddings for Coarse-to-Fine Robot Design](https://mlsanity.com/paper/2311.00462/) (2023)
- [Hyperbolic Geometry in Computer Vision: A Survey](https://mlsanity.com/paper/2304.10764/) (2023)
- [Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features](https://mlsanity.com/paper/2305.00067/) (2023)
- [Self-supervised dense representation learning for live-cell microscopy with time arrow prediction](https://mlsanity.com/paper/2305.05511/) (2023)
- [SAIR: Learning Semantic-aware Implicit Representation](https://mlsanity.com/paper/2310.09285/) (2023)
- [Adversarial Attacks on Hyperbolic Networks](https://mlsanity.com/paper/2412.01495/) (2024)
- [Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation](https://mlsanity.com/paper/2507.06363/) (2025)
- [Hyperbolic Genome Embeddings](https://mlsanity.com/paper/2507.21648/) (2025)
- [Predicate Hierarchies Improve Few-Shot State Classification](https://mlsanity.com/paper/2502.12481/) (2025)
- [Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors](https://mlsanity.com/paper/2506.10146/) (2025)
- [A Set-to-Set Distance Measure in Hyperbolic Space](https://mlsanity.com/paper/2506.18529/) (2025)
- [HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics Prediction](https://mlsanity.com/paper/2511.22107/) (2025)
- [Comparing Euclidean and Hyperbolic K-Means for Generalized Category Discovery](https://mlsanity.com/paper/2602.04932/) (2026)
- [H2AL: Hyperbolic Hierarchy-aware Aggregative Learning for Registration-based Few-shot Medical Image Segmentation](https://mlsanity.com/paper/2608.07340/) (2026)

## Abstract (arXiv)

We consider the task of representation learning for unsupervised segmentation of 3D voxel-grid biomedical images. We show that models that capture implicit hierarchical relationships between subvolumes are better suited for this task. To that end, we consider encoder-decoder architectures with a hyperbolic latent space, to explicitly capture hierarchical relationships present in subvolumes of the data. We propose utilizing a 3D hyperbolic variational autoencoder with a novel gyroplane convolutional layer to map from the embedding space back to 3D images. To capture these relationships, we introduce an essential self-supervised loss -- in addition to the standard VAE loss -- which infers approximate hierarchies and encourages implicitly related subvolumes to be mapped closer in the embedding space. We present experiments on both synthetic data and biomedical data to validate our hypothesis.
