mlsanityData to 7 Oct 2026

Unsupervised Structural Scene Decomposition via Foreground-Aware Slot Attention with Pseudo-Mask Guidance

arXiv 2512.02685 ↗First posted 2 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in object-centric representation learning have shown that slot attention-based methods can effectively decompose visual scenes into object slot representations without supervision. However, existing approaches typically process foreground and background regions indiscriminately, often resulting in background interference and suboptimal instance discovery performance on real-world data. To address this limitation, we propose Foreground-Aware Slot Attention (FASA), a two-stage framework that explicitly separates foreground from background to enable precise object discovery. In the first stage, FASA performs a coarse scene decomposition to distinguish foreground from background regions through a dual-slot competition mechanism. These slots are initialized via a clustering-based strategy, yielding well-structured representations of salient regions. In the second stage, we introduce a masked slot attention mechanism where the first slot captures the background while the remaining slots compete to represent individual foreground objects. To further address over-segmentation of foreground objects, we incorporate pseudo-mask guidance derived from a patch affinity graph constructed with self-supervised image features to guide the learning of foreground slots. Extensive experiments on both synthetic and real-world datasets demonstrate that FASA consistently outperforms state-of-the-art methods, validating the effectiveness of explicit foreground modeling and pseudo-mask guidance for robust scene decomposition and object-coherent representation. Code will be made publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

43 of 53 references.

References · 43

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  10. 2017Decoupled Weight Decay Regularizationcited by 1,722
  11. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  12. 2020Object-Centric Learning with Slot Attentioncited by 865
31 more
  1. 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
  2. 2022Kubric: A scalable dataset generatorcited by 373
  3. 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 359
  4. 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
  5. 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
  6. 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
  7. 2014The Secrets of Salient Object Segmentationcited by 200
  8. 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
  9. 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
  10. 2021Illiterate DALL-E Learns to Composecited by 147
  11. 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
  12. 2019Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEscited by 116
  13. 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
  14. 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
  15. 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
  16. 2023Object-Centric Slot Diffusioncited by 90
  17. 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
  18. 2024Gated Slot Attention for Efficient Linear-Time Sequence Modelingcited by 73
  19. 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
  20. 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
  21. 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
  22. 2023Self-supervised Object-Centric Learning for Videoscited by 49
  23. 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
  24. 2023Unsupervised Universal Image Segmentationcited by 34
  25. 2024Adaptive Slot Attention: Object Discovery with Dynamic Slot Numbercited by 34
  26. 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
  27. 2023Slot-VAE: Object-Centric Scene Generation with Slot Attentioncited by 20
  28. 2023Guided Slot Attention for Unsupervised Video Object Segmentationcited by 19
  29. 2024GLASS: Guided Latent Slot Diffusion for Object-Centric Learningcited by 14
  30. 2025Slot Attention with Re-Initialization and Self-Distillationcited by 14
  31. 20223SD: Self-Supervised Saliency Detection With No Labelscited by 5

Built on by

Not cited yet.