Boosting General Trimap-free Matting in the Real-World Image
Not on the map. Why?
Abstract (arXiv)
Image matting aims to obtain an alpha matte that separates foreground objects from the background accurately. Recently, trimap-free matting has been well studied because it requires only the original image without any extra input. Such methods usually extract a rough foreground by itself to take place trimap as further guidance. However, the definition of 'foreground' lacks a unified standard and thus ambiguities arise. Besides, the extracted foreground is sometimes incomplete due to inadequate network design. Most importantly, there is not a large-scale real-world matting dataset, and current trimap-free methods trained with synthetic images suffer from large domain shift problems in practice. In this paper, we define the salient object as foreground, which is consistent with human cognition and annotations of the current matting dataset. Meanwhile, data and technologies in salient object detection can be transferred to matting in a breeze. To obtain a more accurate and complete alpha matte, we propose a network called Multi-Feature fusion-based Coarse-to-fine Network (MFC-Net), which fully integrates multiple features for an accurate and complete alpha matte. Furthermore, we introduce image harmony in data composition to bridge the gap between synthetic and real images. More importantly, we establish the largest general matting dataset (Real-19k) in the real world to date. Experiments show that our method is significantly effective on both synthetic and real-world images, and the performance in the real-world dataset is far better than existing matting-free methods. Our code and data will be released soon.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 82 references that are in the map. First posted on arXiv 28 May 2024.
Builds on
37 of 82 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Mask R-CNNcited by 7,277
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
- 2013Network In Networkcited by 605
- 2015Holistically-Nested Edge Detectioncited by 592
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
25 more
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2020Global Context-Aware Progressive Aggregation Network for Salient Object Detectioncited by 109
- 2020Background Matting: The World is Your Green Screencited by 105
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2018Semantic Human Mattingcited by 67
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2017Information-Flow Mattingcited by 59
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2021Semantic Image Mattingcited by 55
- 2019Collaborative Global-Local Networks for Memory-Efficient Segmentation of Ultra-High Resolution Imagescited by 51
- 2018AlphaGAN: Generative adversarial networks for natural image mattingcited by 50
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2019Progressive Feature Polishing Network for Salient Object Detectioncited by 34
- 2020F2Net: Learning to Focus on the Foreground for Unsupervised Video Object Segmentationcited by 32
- 2023Continual Learning for Image Segmentation with Dynamic Querycited by 12
- 2019Instance Segmentation based Semantic Matting for Compositing Applicationscited by 7
- 2018Semantic Part Detection via Matching: Learning to Generalize to Novel Viewpoints from Limited Training Datacited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025GDGS: 3D Gaussian Splatting Via Geometry-Guided Initialization And Dynamic Density Controlcited by 2
- 2025Capture Stage Matting: Challenges, Approaches, and Solutions for Offline and Real-Time Processingcited by 0
- 2026Segment and Matte Anything in a Unified Modelcited by 0
- 2026MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoningcited by 0
- 2026MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoning27 Jul 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2025Capture Stage Matting: Challenges, Approaches, and Solutions for Offline and Real-Time Processing10 Jul 2025
- 2025GDGS: 3D Gaussian Splatting Via Geometry-Guided Initialization And Dynamic Density Control1 Jul 2025