Unsupervised Structural Scene Decomposition via Foreground-Aware Slot Attention with Pseudo-Mask Guidance
Not on the map. Why?
Abstract (arXiv)
Recent advances in object-centric representation learning have shown that slot attention-based methods can effectively decompose visual scenes into object slot representations without supervision. However, existing approaches typically process foreground and background regions indiscriminately, often resulting in background interference and suboptimal instance discovery performance on real-world data. To address this limitation, we propose Foreground-Aware Slot Attention (FASA), a two-stage framework that explicitly separates foreground from background to enable precise object discovery. In the first stage, FASA performs a coarse scene decomposition to distinguish foreground from background regions through a dual-slot competition mechanism. These slots are initialized via a clustering-based strategy, yielding well-structured representations of salient regions. In the second stage, we introduce a masked slot attention mechanism where the first slot captures the background while the remaining slots compete to represent individual foreground objects. To further address over-segmentation of foreground objects, we incorporate pseudo-mask guidance derived from a patch affinity graph constructed with self-supervised image features to guide the learning of foreground slots. Extensive experiments on both synthetic and real-world datasets demonstrate that FASA consistently outperforms state-of-the-art methods, validating the effectiveness of explicit foreground modeling and pseudo-mask guidance for robust scene decomposition and object-coherent representation. Code will be made publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
43 of 53 references.
References · 43
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2020Object-Centric Learning with Slot Attentioncited by 865
31 more
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
- 2022Kubric: A scalable dataset generatorcited by 373
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 359
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2021Illiterate DALL-E Learns to Composecited by 147
- 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
- 2019Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEscited by 116
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
- 2023Object-Centric Slot Diffusioncited by 90
- 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
- 2024Gated Slot Attention for Efficient Linear-Time Sequence Modelingcited by 73
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2023SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformerscited by 49
- 2023Unsupervised Universal Image Segmentationcited by 34
- 2024Adaptive Slot Attention: Object Discovery with Dynamic Slot Numbercited by 34
- 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
- 2023Slot-VAE: Object-Centric Scene Generation with Slot Attentioncited by 20
- 2023Guided Slot Attention for Unsupervised Video Object Segmentationcited by 19
- 2024GLASS: Guided Latent Slot Diffusion for Object-Centric Learningcited by 14
- 2025Slot Attention with Re-Initialization and Self-Distillationcited by 14
- 20223SD: Self-Supervised Saliency Detection With No Labelscited by 5
Built on by
Not cited yet.