Bootstrapping Top-down Information for Self-modulating Slot Attention
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Object-centric learning (OCL) aims to learn representations of individual objects within visual scenes without manual supervision, facilitating efficient and effective visual reasoning. Traditional OCL methods primarily employ bottom-up approaches that aggregate homogeneous visual features to represent objects. However, in complex visual environments, these methods often fall short due to the heterogeneous nature of visual features within an object. To address this, we propose a novel OCL framework incorporating a top-down pathway. This pathway first bootstraps the semantics of individual objects and then modulates the model to prioritize features relevant to these semantics. By dynamically modulating the model based on its own output, our top-down pathway enhances the representational quality of objects. Our framework achieves state-of-the-art performance across multiple synthetic and real-world object-discovery benchmarks.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 50 references that are in the map. First posted on arXiv 4 Nov 2024.
Builds on
45 of 50 references.
Closest ancestors · 2
Same direction, newest first
- 2023Systematic Visual Reasoning through Object-Centric Relational Abstraction4 Jun
- 2023Object-centric Learning with Cyclic Walks between Parts and Whole16 Feb
Other references · 43
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
31 more
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2021Illiterate DALL-E Learns to Composecited by 147
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
- 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
- 2023Object-Centric Slot Diffusioncited by 90
- 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
- 2021Generalization and Robustness Implications in Object-Centric Learningcited by 81
- 2023Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networkscited by 80
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2023Invariant Slot Attention: Object Discovery with Slot-Centric Reference Framescited by 51
- 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
- 2022Object Representations as Fixed Points: Training Iterative Refinement Algorithms with Implicit Differentiationcited by 46
- 2021TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentationcited by 38
- 2022Neural Systematic Bindercited by 37
- 2022Improving Cross-Modal Retrieval with Set of Diverse Embeddingscited by 33
- 2023Rotating Features for Object Discoverycited by 29
- 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
- 2023Top-Down Visual Attention from Analysis by Synthesiscited by 19
- 2023Shepherding Slots to Objects: Towards Stable and Robust Object-Centric Learningcited by 17
- 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Imagescited by 16
- 2023Neural Radiance Field Codebookscited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2026DiCo: Disentangled Concept Representation for Text-to-image Person Re-identificationcited by 2
- 2026MUFASA: A Multi-Layer Framework for Slot Attentioncited by 1
- 2025ContextFusion and Bootstrap: An Effective Approach to Improve Slot Attention-Based Object-Centric Learningcited by 0
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusioncited by 0
- 2026Evaluating Object-Centric Models beyond Object Discoverycited by 0
- 2026When Slots Compete: Slot Merging in Object-Centric Learningcited by 0
- 2026When Slots Compete: Slot Merging in Object-Centric Learning11 Mar 2026
- 2026MUFASA: A Multi-Layer Framework for Slot Attention7 Feb 2026
- 2026Evaluating Object-Centric Models beyond Object Discovery7 Feb 2026
- 2026DiCo: Disentangled Concept Representation for Text-to-image Person Re-identification15 Jan 2026
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusion11 Sep 2025
- 2025ContextFusion and Bootstrap: An Effective Approach to Improve Slot Attention-Based Object-Centric Learning2 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Object-Centric Pretraining via Target Encoder Bootstrapping
- 2026Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders
- 2024Learning to Compose: Improving Object Centric Learning by Injecting Compositionality
- 2026Finding Distributed Object-Centric Properties in Self-Supervised Transformers
- 2025Learning Object-Centric Representations Based on Slots in Real World Scenarios
- 2026Improved Object-Centric Diffusion Learning with Registers and Contrastive Alignment
- 2026SlotVTG: Object-Centric Adapter for Generalizable Video Temporal Grounding
- 2024Visual Reasoning in Object-Centric Deep Neural Networks: A Comparative Cognition Approach