mlsanityData to 7 Oct 2026

Bootstrapping Top-down Information for Self-modulating Slot Attention

arXiv 2411.01801 ↗First posted 4 Nov 2024cs.CV cs.LGcited by 6

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Object-centric learning (OCL) aims to learn representations of individual objects within visual scenes without manual supervision, facilitating efficient and effective visual reasoning. Traditional OCL methods primarily employ bottom-up approaches that aggregate homogeneous visual features to represent objects. However, in complex visual environments, these methods often fall short due to the heterogeneous nature of visual features within an object. To address this, we propose a novel OCL framework incorporating a top-down pathway. This pathway first bootstraps the semantics of individual objects and then modulates the model to prioritize features relevant to these semantics. By dynamically modulating the model based on its own output, our top-down pathway enhances the representational quality of objects. Our framework achieves state-of-the-art performance across multiple synthetic and real-world object-discovery benchmarks.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 50 references that are in the map. First posted on arXiv 4 Nov 2024.

Builds on

45 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Systematic Visual Reasoning through Object-Centric Relational Abstraction4 Jun
  2. 2023Object-centric Learning with Cyclic Walks between Parts and Whole16 Feb

Other references · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2017Neural Discrete Representation Learningcited by 4,650
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  7. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  8. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  9. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  11. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
  12. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
31 more
  1. 2020Object-Centric Learning with Slot Attentioncited by 865
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  3. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  4. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  5. 2022Kubric: A scalable dataset generatorcited by 373
  6. 2021Conditional Object-Centric Learning from Videocited by 247
  7. 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
  8. 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
  9. 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
  10. 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
  11. 2021Illiterate DALL-E Learns to Composecited by 147
  12. 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
  13. 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
  14. 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
  15. 2023Object-Centric Slot Diffusioncited by 90
  16. 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
  17. 2021Generalization and Robustness Implications in Object-Centric Learningcited by 81
  18. 2023Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networkscited by 80
  19. 2022Improving Object-centric Learning with Query Optimizationcited by 60
  20. 2023Invariant Slot Attention: Object Discovery with Slot-Centric Reference Framescited by 51
  21. 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
  22. 2022Object Representations as Fixed Points: Training Iterative Refinement Algorithms with Implicit Differentiationcited by 46
  23. 2021TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentationcited by 38
  24. 2022Neural Systematic Bindercited by 37
  25. 2022Improving Cross-Modal Retrieval with Set of Diverse Embeddingscited by 33
  26. 2023Rotating Features for Object Discoverycited by 29
  27. 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
  28. 2023Top-Down Visual Attention from Analysis by Synthesiscited by 19
  29. 2023Shepherding Slots to Objects: Towards Stable and Robust Object-Centric Learningcited by 17
  30. 2022Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Imagescited by 16
  31. 2023Neural Radiance Field Codebookscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Object-Centric Pretraining via Target Encoder Bootstrapping
  2. 2026Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders
  3. 2024Learning to Compose: Improving Object Centric Learning by Injecting Compositionality
  4. 2026Finding Distributed Object-Centric Properties in Self-Supervised Transformers
  5. 2025Learning Object-Centric Representations Based on Slots in Real World Scenarios
  6. 2026Improved Object-Centric Diffusion Learning with Registers and Contrastive Alignment
  7. 2026SlotVTG: Object-Centric Adapter for Generalizable Video Temporal Grounding
  8. 2024Visual Reasoning in Object-Centric Deep Neural Networks: A Comparative Cognition Approach