Mask Guided Matting via Progressive Refinement Network
Not on the map. Why?
Abstract (arXiv)
We propose Mask Guided (MG) Matting, a robust matting framework that takes a general coarse mask as guidance. MG Matting leverages a network (PRN) design which encourages the matting model to provide self-guidance to progressively refine the uncertain regions through the decoding process. A series of guidance mask perturbation operations are also introduced in the training to further enhance its robustness to external guidance. We show that PRN can generalize to unseen types of guidance masks such as trimap and low-quality alpha matte, making it suitable for various application pipelines. In addition, we revisit the foreground color prediction problem for matting and propose a surprisingly simple improvement to address the dataset issue. Evaluation on real and synthetic benchmarks shows that MG Matting achieves state-of-the-art performance using various types of guidance inputs. Code and models are available at https://github.com/yucornetto/MGMatting.
Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 18; 2023: 19; 2024: 18; 2025: 12; 2026: 10.
84 papers.
Sort:
By area:
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2022Self-Supervised Masking for Unsupervised Anomaly Detection and Localizationcited by 43
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2021High Quality Segmentation for Ultra High-resolution Imagescited by 31
- 2023Matting Anythingcited by 31
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Processcited by 29
38 more
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
- 2021Wavelength-based Attributed Deep Neural Network for Underwater Image Restorationcited by 23
- 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
- 2022Referring Image Mattingcited by 22
- 2022VMFormer: End-to-End Video Matting with Transformercited by 20
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentationcited by 17
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformerscited by 15
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generationcited by 14
- 2024Matting by Generationcited by 13
- 2022One-Trimap Video Mattingcited by 12
- 2022Robust Human Matting via Semantic Guidancecited by 12
- 2023Deep Image Matting: A Comprehensive Surveycited by 12
- 2021Cascade Image Matting with Deformable Graph Refinementcited by 11
- 2023Diffusion for Natural Image Mattingcited by 11
- 2025Consistent Image Layout Editing with Diffusion Modelscited by 9
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2023Adaptive Human Matting for Dynamic Videoscited by 7
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
- 2022Exposure Correction Model to Enhance Image Qualitycited by 6
- 2023Revisiting Context Aggregation for Image Mattingcited by 5
- 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5
- 2022Hierarchical and Progressive Image Mattingcited by 4
- 2023Adversarially-Guided Portrait Mattingcited by 4
- 2023dugMatting: Decomposed-Uncertainty-Guided Mattingcited by 4
- 2023Video Instance Mattingcited by 4
- 2023Progressive Feedback-Enhanced Transformer for Image Forgery Localizationcited by 4
- 2024End-to-End Human Instance Mattingcited by 4
- 2024Boosting General Trimap-free Matting in the Real-World Imagecited by 4
- 2024Training Matting Models without Alpha Labelscited by 4
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 4
- 2021Alpha Matte Generation from Single Input for Portrait Mattingcited by 3
- 2022Situational Perception Guided Image Mattingcited by 3
- 2024In-Context Mattingcited by 3
50 most cited of 84 All 84 (JSON)
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework8 May 2026
- 2026Can Image Splicing and Copy-Move Forgery Be Detected by the Same Model? Forensim: An Attention-Based State-Space Approach10 Feb 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2026Rescind: Countering Image Misconduct in Biomedical Publications with Vision-Language and State-Space Modeling12 Jan 2026
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition26 Dec 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
38 more
- 2025Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation5 Aug 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2025BiVM: Accurate Binarized Neural Network for Efficient Video Matting6 Jul 2025
- 2025MP-Mat: A 3D-and-Instance-Aware Human Matting and Editing Framework with Multiplane Representation20 Apr 2025
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion11 Mar 2025
- 2025Consistent Image Layout Editing with Diffusion Models9 Mar 2025
- 2025Object-Aware Video Matting with Cross-Frame Guidance3 Mar 2025
- 2025Enhancing Image Matting in Real-World Scenes with Mask-Guided Iterative Refinement24 Feb 2025
- 2025Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors27 Jan 2025
- 2024UNet--: Memory-Efficient and Feature-Enhanced Network Architecture based on U-Net with Reduced Skip-Connections24 Dec 2024
- 2024Memory Efficient Matting with Adaptive Token Routing14 Dec 2024
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation16 Nov 2024
- 2024ZIM: Zero-Shot Image Matting for Anything1 Nov 2024
- 2024DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios13 Oct 2024
- 2024Towards Natural Image Matting in the Wild via Real-Scenario Prior9 Oct 2024
- 2024Training Matting Models without Alpha Labels20 Aug 2024
- 2024Matting by Generation30 Jul 2024
- 2024Boosting General Trimap-free Matting in the Real-World Image28 May 2024
- 2024MaGGIe: Masked Guided Gradual Human Instance Matting24 Apr 2024
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generation3 Apr 2024
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting28 Mar 2024
- 2024In-Context Matting23 Mar 2024
- 2024End-to-End Human Instance Matting3 Mar 2024
- 2024Dual-Context Aggregation for Universal Image Matting28 Feb 2024
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentation7 Jan 2024
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Process19 Dec 2023
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement11 Dec 2023
- 2023Diffusion for Natural Image Matting10 Dec 2023
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2023Progressive Feedback-Enhanced Transformer for Image Forgery Localization15 Nov 2023
- 2023Video Instance Matting7 Nov 2023
- 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localization10 Aug 2023
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentation26 Jul 2023
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul 2023
- 2023Matting Anything8 Jun 2023
50 newest of 84 All 84 (JSON)
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Processcited by 29
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generationcited by 14
- 2025Consistent Image Layout Editing with Diffusion Modelscited by 9
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decompositioncited by 1
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition26 Dec 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2025Consistent Image Layout Editing with Diffusion Models9 Mar 2025
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation16 Nov 2024
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Process19 Dec 2023
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement11 Dec 2023
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul 2023
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2022Self-Supervised Masking for Unsupervised Anomaly Detection and Localizationcited by 43
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2021High Quality Segmentation for Ultra High-resolution Imagescited by 31
- 2023Matting Anythingcited by 31
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
12 most cited of 75 All 75 (JSON)
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework8 May 2026
- 2026Can Image Splicing and Copy-Move Forgery Be Detected by the Same Model? Forensim: An Attention-Based State-Space Approach10 Feb 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2026Rescind: Countering Image Misconduct in Biomedical Publications with Vision-Language and State-Space Modeling12 Jan 2026
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
- 2025Uncertainty-Guided Face Matting for Occlusion-Aware Face Transformation5 Aug 2025
12 newest of 75 All 75 (JSON)