Exploring the Interactive Guidance for Unified and Effective Image Matting
Not on the map. Why?
Abstract (arXiv)
Recent image matting studies are developing towards proposing trimap-free or interactive methods for complete complex image matting tasks. Although avoiding the extensive labors of trimap annotation, existing methods still suffer from two limitations: (1) For the single image with multiple objects, it is essential to provide extra interaction information to help determining the matting target; (2) For transparent objects, the accurate regression of alpha matte from RGB image is much more difficult compared with the opaque ones. In this work, we propose a Unified Interactive image Matting method, named UIM, which solves the limitations and achieves satisfying matting results for any scenario. Specifically, UIM leverages multiple types of user interaction to avoid the ambiguity of multiple matting targets, and we compare the pros and cons of different annotation types in detail. To unify the matting performance for transparent and opaque objects, we decouple image matting into two stages, i.e., foreground segmentation and transparency prediction. Moreover, we design a multi-scale attentive fusion module to alleviate the vagueness in the boundary region. Experimental results demonstrate that UIM achieves state-of-the-art performance on the Composition-1K test set and a synthetic unified dataset.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 87 references that are in the map. First posted on arXiv 17 May 2022.
Builds on
36 of 87 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
- 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 226
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
24 more
- 2017Deep Image Mattingcited by 150
- 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
- 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
- 2018Normalized Cut Loss for Weakly-supervised CNN Segmentationcited by 112
- 2020Background Matting: The World is Your Green Screencited by 104
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2017Extreme clicking for efficient object annotationcited by 80
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2017Information-Flow Mattingcited by 59
- 2019Learning Spatial Fusion for Single-Shot Object Detectioncited by 59
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2018Iteratively Trained Interactive Segmentationcited by 52
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2019Disentangled Image Mattingcited by 47
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
- 2018TOM-Net: Learning Transparent Object Matting from a Single Imagecited by 34
- 2017Deep GrabCut for Object Selectioncited by 33
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2020Improved Image Matting via Real-time User Clicks and Uncertainty Estimationcited by 22
- 2018A Fully Convolutional Two-Stream Fusion Network for Interactive Image Segmentationcited by 15
- 2021Smart Scribbles for Image Matingcited by 11
- 2021Prior-Induced Information Alignment for Image Mattingcited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2026SAM2Matting: Generalized Image and Video Mattingcited by 0
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025