Natural Image Matting via Guided Contextual Attention
Not on the map. Why?
Abstract (arXiv)
Over the last few years, deep learning based approaches have achieved outstanding improvements in natural image matting. Many of these methods can generate visually plausible alpha estimations, but typically yield blurry structures or textures in the semitransparent area. This is due to the local ambiguity of transparent objects. One possible solution is to leverage the far-surrounding information to estimate the local opacity. Traditional affinity-based methods often suffer from the high computational complexity, which are not suitable for high resolution alpha estimation. Inspired by affinity-based method and the successes of contextual attention in inpainting, we develop a novel end-to-end approach for natural image matting with a guided contextual attention module, which is specifically designed for image matting. Guided contextual attention module directly propagates high-level opacity information globally based on the learned low-level affinity. The proposed method can mimic information flow of affinity-based methods and utilize rich features learned by deep neural networks simultaneously. Experiment results on Composition-1k testing set and alphamatting.com benchmark dataset demonstrate that our method outperforms state-of-the-art approaches in natural image matting. Code and models are available at https://github.com/Yaoyi-Li/GCA-Matting.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 20; 2023: 16; 2024: 12; 2025: 6; 2026: 5.
78 papers.
Sort:
By area:
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Semantic Image Mattingcited by 55
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 35
- 2023Matting Anythingcited by 30
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
38 more
- 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
- 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
- 2022Referring Image Mattingcited by 22
- 2022VMFormer: End-to-End Video Matting with Transformercited by 20
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformerscited by 15
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 15
- 2021Long-Range Feature Propagating for Natural Image Mattingcited by 13
- 2022One-Trimap Video Mattingcited by 12
- 2023Deep Image Matting: A Comprehensive Surveycited by 12
- 2021Cascade Image Matting with Deformable Graph Refinementcited by 11
- 2023Diffusion for Natural Image Mattingcited by 11
- 2021Multi-scale Information Assembly for Image Mattingcited by 10
- 2022FactorMatte: Redefining Video Matting for Re-Composition Taskscited by 8
- 2023Adaptive Human Matting for Dynamic Videoscited by 7
- 2021Salient Image Mattingcited by 6
- 2021Prior-Induced Information Alignment for Image Mattingcited by 6
- 2021Highly Efficient Natural Image Mattingcited by 6
- 2021Deep Image Matting with Flexible Guidance Inputcited by 5
- 2022Test-time Adaptation vs. Training-time Generalization: A Case Study in Human Instance Segmentation using Keypoints Estimationcited by 5
- 2023Revisiting Context Aggregation for Image Mattingcited by 5
- 2022Hierarchical and Progressive Image Mattingcited by 4
- 2023dugMatting: Decomposed-Uncertainty-Guided Mattingcited by 4
- 2023EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Mattingcited by 4
- 2023Lightweight Portrait Matting via Regional Attention and Refinementcited by 4
- 2023Video Instance Mattingcited by 4
- 2024End-to-End Human Instance Mattingcited by 4
- 2024Boosting General Trimap-free Matting in the Real-World Imagecited by 4
- 2024Training Matting Models without Alpha Labelscited by 4
- 2021Alpha Matte Generation from Single Input for Portrait Mattingcited by 3
- 2022Situational Perception Guided Image Mattingcited by 3
- 2022Self-supervised Matting-specific Portrait Enhancement and Generationcited by 3
- 2024In-Context Mattingcited by 3
- 2024Learning Trimaps via Clicks for Image Mattingcited by 3
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Mattingcited by 3
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2021SketchHairSalon: Deep Sketch-based Hair Image Synthesiscited by 2
- 2021Trimap-guided Feature Mining and Fusion Network for Natural Image Mattingcited by 2
50 most cited of 78 All 78 (JSON)
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition26 Dec 2025
- 2025Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation5 Aug 2025
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion11 Mar 2025
- 2025Path-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints5 Mar 2025
- 2025Object-Aware Video Matting with Cross-Frame Guidance3 Mar 2025
- 2025Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors27 Jan 2025
- 2024Memory Efficient Matting with Adaptive Token Routing14 Dec 2024
38 more
- 2024ZIM: Zero-Shot Image Matting for Anything1 Nov 2024
- 2024DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios13 Oct 2024
- 2024Training Matting Models without Alpha Labels20 Aug 2024
- 2024Boosting General Trimap-free Matting in the Real-World Image28 May 2024
- 2024MaGGIe: Masked Guided Gradual Human Instance Matting24 Apr 2024
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting28 Mar 2024
- 2024In-Context Matting23 Mar 2024
- 2024End-to-End Human Instance Matting3 Mar 2024
- 2024Dual-Context Aggregation for Universal Image Matting28 Feb 2024
- 2023Diffusion for Natural Image Matting10 Dec 2023
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2023Video Instance Matting7 Nov 2023
- 2023Lightweight Portrait Matting via Regional Attention and Refinement7 Nov 2023
- 2023Virtual Accessory Try-On via Keypoint Hallucination26 Oct 2023
- 2023EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Matting24 Aug 2023
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul 2023
- 2023Matting Anything8 Jun 2023
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Models7 Jun 2023
- 2023dugMatting: Decomposed-Uncertainty-Guided Matting2 Jun 2023
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformers24 May 2023
- 2023Adaptive Human Matting for Dynamic Videos12 Apr 2023
- 2023Deep Image Matting: A Comprehensive Survey10 Apr 2023
- 2023Revisiting Context Aggregation for Image Matting3 Apr 2023
- 2023Disentangled Pre-training for Image Matting3 Apr 2023
- 2023TransMatting: Tri-token Equipped Transformer Model for Image Matting11 Mar 2023
- 2022Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting27 Dec 2022
- 2022Test-time Adaptation vs. Training-time Generalization: A Case Study in Human Instance Segmentation using Keypoints Estimation12 Dec 2022
- 2022Privileged Prior Information Distillation for Image Matting25 Nov 2022
- 2022FactorMatte: Redefining Video Matting for Re-Composition Tasks3 Nov 2022
- 2022Lightweight Alpha Matting Network Using Distillation-Based Channel Pruning14 Oct 2022
- 2022Wider and Higher: Intensive Integration and Global Foreground Perception for Image Matting13 Oct 2022
- 2022Hierarchical and Progressive Image Matting13 Oct 2022
- 2022VMFormer: End-to-End Video Matting with Transformer26 Aug 2022
- 2022SGM-Net: Semantic Guided Matting Net16 Aug 2022
- 2022Self-supervised Matting-specific Portrait Enhancement and Generation13 Aug 2022
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformers5 Aug 2022
50 newest of 78 All 78 (JSON)
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Semantic Image Mattingcited by 55
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2023Matting Anythingcited by 30
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
- 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
12 most cited of 75 All 75 (JSON)
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2025Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation5 Aug 2025
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion11 Mar 2025
- 2025Path-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints5 Mar 2025
- 2025Object-Aware Video Matting with Cross-Frame Guidance3 Mar 2025
- 2025Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors27 Jan 2025
- 2024Memory Efficient Matting with Adaptive Token Routing14 Dec 2024
- 2024ZIM: Zero-Shot Image Matting for Anything1 Nov 2024
12 newest of 75 All 75 (JSON)