Self-supervised Automatic Matting
Not on the map. Why?
Abstract (arXiv)
High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or masks, they remain reliant on costly per-pixel supervision, limiting scalability and generalization. In this work, we push the boundary further and ask: can we train an automatic matting model using only RGB images, with no manual annotation at all? We answer this by presenting SSMatte, a self-supervised framework that for the first time achieves performance on par with fully-supervised automatic matting. Our key insight is to decompose the problem into semantic anchoring and detail matting. SSMatte first generates a semantic matting prompt from frozen self-supervised ViT features by propagating class-token seeds via a novel, training-efficient semantic anchoring loss based on a generalized Rayleigh quotient. This prompt then anchors a detail matting network, which is optimized via a fixed-point-based loss that enforces alpha-RGB consistency. Extensive experiments show SSMatte outperforms prior weakly-supervised methods, matches the performance of fully-supervised models on portrait benchmarks, and demonstrates favorable scaling and generalization behaviors with additional data. Our work pushes automatic matting to an fresh, fully annotation-free paradigm. Code will be available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
31 of 47 references.
References · 31
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2020Real-Time High-Resolution Background Mattingcited by 173
- 2017Deep Image Mattingcited by 150
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
19 more
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 113
- 2020Background Matting: The World is Your Green Screencited by 105
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2018Semantic Human Mattingcited by 67
- 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2020Improved Image Matting via Real-time User Clicks and Uncertainty Estimationcited by 22
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2025Does Object Binding Naturally Emerge in Large Pretrained Vision Transformers?cited by 19
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2021Salient Image Mattingcited by 6
- 2024Training Matting Models without Alpha Labelscited by 4
- 2021Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interactioncited by 3
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Mattingcited by 3
- 2023Disentangled Pre-training for Image Mattingcited by 2
Built on by
Not cited yet.