Disentangled Pre-training for Image Matting
Not on the map. Why?
Abstract (arXiv)
Image matting requires high-quality pixel-level human annotations to support the training of a deep model in recent literature. Whereas such annotation is costly and hard to scale, significantly holding back the development of the research. In this work, we make the first attempt towards addressing this problem, by proposing a self-supervised pre-training approach that can leverage infinite numbers of data to boost the matting performance. The pre-training task is designed in a similar manner as image matting, where random trimap and alpha matte are generated to achieve an image disentanglement objective. The pre-trained model is then used as an initialisation of the downstream matting task for fine-tuning. Extensive experimental evaluations show that the proposed approach outperforms both the state-of-the-art matting methods and other alternative self-supervised initialisation approaches by a large margin. We also show the robustness of the proposed approach over different backbone architectures. Our project page is available at https://crystraldo.github.io/dpt_mat/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 3 Apr 2023.
Builds on
30 of 48 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2017Deep Image Mattingcited by 150
18 more
- 2020Unsupervised Learning of Dense Visual Representationscited by 147
- 2021Self-Supervised Learning with Swin Transformerscited by 121
- 2020Background Matting: The World is Your Green Screencited by 104
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2021Semantic Image Mattingcited by 55
- 2018AlphaGAN: Generative adversarial networks for natural image mattingcited by 50
- 2020F, B, Alpha Mattingcited by 50
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2020Parametric Instance Classification for Unsupervised Visual Feature Learningcited by 41
- 2020High-Resolution Deep Image Mattingcited by 36
- 2022CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentationcited by 26
- 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
- 2022Referring Image Mattingcited by 22
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformerscited by 15
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.