Dual-Context Aggregation for Universal Image Matting
Not on the map. Why?
Abstract (arXiv)
Natural image matting aims to estimate the alpha matte of the foreground from a given image. Various approaches have been explored to address this problem, such as interactive matting methods that use guidance such as click or trimap, and automatic matting methods tailored to specific objects. However, existing matting methods are designed for specific objects or guidance, neglecting the common requirement of aggregating global and local contexts in image matting. As a result, these methods often encounter challenges in accurately identifying the foreground and generating precise boundaries, which limits their effectiveness in unforeseen scenarios. In this paper, we propose a simple and universal matting framework, named Dual-Context Aggregation Matting (DCAM), which enables robust image matting with arbitrary guidance or without guidance. Specifically, DCAM first adopts a semantic backbone network to extract low-level features and context features from the input image and guidance. Then, we introduce a dual-context aggregation network that incorporates global object aggregators and local appearance aggregators to iteratively refine the extracted context features. By performing both global contour segmentation and local boundary refinement, DCAM exhibits robustness to diverse types of guidance and objects. Finally, we adopt a matting decoder network to fuse the low-level features and the refined context features for alpha matte estimation. Experimental results on five matting datasets demonstrate that the proposed DCAM outperforms state-of-the-art matting methods in both automatic matting and interactive matting tasks, which highlights the strong universality and high performance of DCAM. The source code is available at urlhttps://github.com/Windaway/DCAM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 62 references that are in the map. First posted on arXiv 28 Feb 2024.
Builds on
34 of 62 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2017Deep Image Mattingcited by 150
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
22 more
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2018Semantic Human Mattingcited by 67
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2017Information-Flow Mattingcited by 59
- 2021Semantic Image Mattingcited by 55
- 2020F, B, Alpha Mattingcited by 50
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2019Disentangled Image Mattingcited by 47
- 2020Learning Affinity-Aware Upsampling for Deep Image Mattingcited by 37
- 2020High-Resolution Deep Image Mattingcited by 36
- 2017Fast Deep Matting for Portrait Animation on Mobile Phonecited by 30
- 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
- 2023Head-Free Lightweight Semantic Segmentation with Linear Transformercited by 22
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformerscited by 15
- 2021Cascade Image Matting with Deformable Graph Refinementcited by 11
- 2022Hierarchical and Progressive Image Mattingcited by 4
- 2021Improving Deep Image Matting via Local Smoothness Assumptioncited by 2
Built on by
Not cited yet.