A Hyperbolic Perspective on Hierarchical Structure in Object-Centric Scene Representations
Not on the map. Why?
Abstract (arXiv)
Slot attention has emerged as a powerful framework for unsupervised object-centric learning, decomposing visual scenes into a small set of compact vector representations called slots, each capturing a distinct region or object. However, these slots are learned in Euclidean space, which provides no geometric inductive bias for the hierarchical relationships that naturally structure visual scenes. In this work, we propose a simple post-hoc pipeline to project Euclidean slot embeddings onto the Lorentz hyperboloid of hyperbolic space, without modifying the underlying training pipeline. We construct five-level visual hierarchies directly from slot attention masks and analyse whether hyperbolic geometry reveals latent hierarchical structure that remains invisible in Euclidean space. Integrating our pipeline with SPOT (images), VideoSAUR (video), and SlotContrast (video), We find that hyperbolic projection exposes a consistent scene-level to object-level organisation, where coarse slots occupy greater manifold depth than fine slots, which is absent in Euclidean space. We further identify a "curvature--task tradeoff": low curvature (c=0.2) matches or outperforms Euclidean on parent slot retrieval, while moderate curvature (c=0.5) achieves better inter-level separation. Together, these findings suggest that slot representations already encode latent hierarchy that hyperbolic geometry reveals, motivating end-to-end hyperbolic training as a natural next step. Code and models are available at hrefhttps://github.com/NeeluMadan/HHSgithub.com/NeeluMadan/HHS.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 49 of its 55 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
49 of 55 references.
References · 49
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2017Dynamic Routing Between Capsulescited by 689
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 529
- 2018Hyperbolic Neural Networkscited by 393
- 2019Video Instance Segmentationcited by 391
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 359
37 more
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2019Hyperbolic Graph Neural Networkscited by 244
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2018Poincar'e GloVe: Hyperbolic Word Embeddingscited by 155
- 2021Illiterate DALL-E Learns to Composecited by 147
- 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
- 2023Hyperbolic Image-Text Representationscited by 132
- 2021How to represent part-whole hierarchies in a neural networkcited by 123
- 2021Fully Hyperbolic Neural Networkscited by 107
- 2022Hyperbolic Image Segmentationcited by 101
- 2021Unsupervised Discovery of Object Radiance Fieldscited by 100
- 2022Object Scene Representation Transformercited by 90
- 2019Stacked Capsule Autoencoderscited by 82
- 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
- 2016Tagger: Deep Unsupervised Perceptual Groupingcited by 69
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
- 2024Temporally Consistent Object-Centric Learning by Contrasting Slotscited by 30
- 2022Unsupervised Discovery and Composition of Object Light Fieldscited by 28
- 2024Zero-Shot Object-Centric Representation Learningcited by 19
- 2025Hyperbolic Safety-Aware Vision-Language Modelscited by 17
- 2025Slot Attention with Re-Initialization and Self-Distillationcited by 14
- 2024SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fieldscited by 12
- 2024HiHPQ: Hierarchical Hyperbolic Product Quantization for Unsupervised Image Retrievalcited by 11
- 2025Vector-Quantized Vision Foundation Models for Object-Centric Learningcited by 11
- 2024Learning Visual Hierarchies in Hyperbolic Space for Image Retrievalcited by 8
- 2015Hyperbolicity Measures "Democracy" in Real-World Networkscited by 4
- 2024HypDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-shot Image Generationcited by 3
- 2025Differentiable Hierarchical Visual Tokenizationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.