Efficient Object-centric Representation Learning with Pre-trained Geometric Prior
Not on the map. Why?
Abstract (arXiv)
This paper addresses key challenges in object-centric representation learning of video. While existing approaches struggle with complex scenes, we propose a novel weakly-supervised framework that emphasises geometric understanding and leverages pre-trained vision models to enhance object discovery. Our method introduces an efficient slot decoder specifically designed for object-centric learning, enabling effective representation of multi-object scenes without requiring explicit depth information. Results on synthetic video benchmarks with increasing complexity in terms of objects and their movement, object occlusion and camera motion demonstrate that our approach achieves comparable performance to supervised methods while maintaining computational efficiency. This advances the field towards more practical applications in complex real-world scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 16 Dec 2024.
Builds on
21 of 23 references.
References · 21
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2022Kubric: A scalable dataset generatorcited by 373
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 359
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 301
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2020On the Binding Problem in Artificial Neural Networkscited by 230
9 more
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2019Contrastive Learning of Structured World Modelscited by 206
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2017Neural Expectation Maximizationcited by 123
- 2022OmniMAE: Single Model Masked Pretraining on Images and Videoscited by 99
- 2021SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decompositioncited by 69
- 2023The effectiveness of MAE pre-pretraining for billion-scale pretrainingcited by 68
- 2020Attention over learned object embeddings enables complex visual reasoningcited by 59
Built on by
Citing papers per year: 2025: 1.
1 paper.