Deep Image Matting
Not on the map. Why?
Abstract (arXiv)
Image matting is a fundamental computer vision problem and has many applications. Previous algorithms have poor performance when an image has similar foreground and background colors or complicated textures. The main reasons are prior methods 1) only use low-level features and 2) lack high-level context. In this paper, we propose a novel deep learning based algorithm that can tackle both these problems. Our deep model has two parts. The first part is a deep convolutional encoder-decoder network that takes an image and the corresponding trimap as inputs and predict the alpha matte of the image. The second part is a small convolutional network that refines the alpha matte predictions of the first network to have more accurate alpha values and sharper edges. In addition, we also create a large-scale image matting dataset including 49300 training images and 1000 testing images. We evaluate our algorithm on the image matting benchmark, our testing set, and a wide variety of real images. Experimental results clearly demonstrate the superiority of our algorithm over previous methods.
Key facts. Cited by 150 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 33; 2023: 23; 2024: 28; 2025: 20; 2026: 11.
150 papers.
Sort:
By area:
- 2021Concealed Object Detectioncited by 212
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 102
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Semantic Image Mattingcited by 55
- 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
38 more
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
- 2021Boundary-Aware Segmentation Network for Mobile and Web Applicationscited by 42
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
- 2022A Unified Query-based Paradigm for Point Cloud Understandingcited by 32
- 2022SAPA: Similarity-Aware Point Affiliation for Feature Upsamplingcited by 32
- 2023Matting Anythingcited by 31
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentationcited by 29
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
- 2022FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsamplingcited by 25
- 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
- 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
- 2022Referring Image Mattingcited by 22
- 2023Head-Free Lightweight Semantic Segmentation with Linear Transformercited by 22
- 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
- 2022VMFormer: End-to-End Video Matting with Transformercited by 20
- 2023InterFormer: Real-time Interactive Image Segmentationcited by 20
- 2024Alfie: Democratising RGBA Image Generation With No cited by 20
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 20
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2021Convolutional Neural Opacity Radiance Fieldscited by 16
- 2024ZIM: Zero-Shot Image Matting for Anythingcited by 16
- 2022TransMatting: Enhancing Transparent Objects Matting with Transformerscited by 15
- 2021IICNet: A Generic Framework for Reversible Image Conversioncited by 13
- 2021Long-Range Feature Propagating for Natural Image Mattingcited by 13
- 2024Exploring the Synergies of Hybrid CNNs and ViTs Architectures for Computer Vision: A surveycited by 13
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13
- 2021Towards Enhancing Fine-grained Details for Image Mattingcited by 12
- 2022One-Trimap Video Mattingcited by 12
50 most cited of 150 All 150 (JSON)
- 2026Overpainting: Localized Context-aware Diffusion Image Editing9 Sep 2026
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal26 Jun 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Generating Humanless Environment Walkthroughs from Egocentric Walking Tour Videos30 Mar 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformer10 Dec 2025
38 more
- 2025Rectifying Latent Space for Generative Single-Image Reflection Removal6 Dec 2025
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers24 Nov 2025
- 2025Synthetic Object Compositions for Scalable and Accurate Learning in Detection, Segmentation, and Grounding10 Oct 2025
- 2025LayerD: Decomposing Raster Graphic Designs into Layers29 Sep 2025
- 2025Generative AI for Enhanced Wildfire Detection: Bridging the Synthetic-Real Domain Gap2 Sep 2025
- 2025Trans-Adapter: A Plug-and-Play Framework for Transparent Image Inpainting1 Aug 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2025Capture Stage Matting: Challenges, Approaches, and Solutions for Offline and Real-Time Processing10 Jul 2025
- 2025BiVM: Accurate Binarized Neural Network for Efficient Video Matting6 Jul 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025MoE-Gyro: Self-Supervised Over-Range Reconstruction and Denoising for MEMS Gyroscopes27 May 2025
- 2025HyperNVD: Accelerating Neural Video Decomposition via Hypernetworks21 Mar 2025
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion11 Mar 2025
- 2025Path-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints5 Mar 2025
- 2025Object-Aware Video Matting with Cross-Frame Guidance3 Mar 2025
- 2025Enhancing Image Matting in Real-World Scenes with Mask-Guided Iterative Refinement24 Feb 2025
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement10 Feb 2025
- 2025Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors27 Jan 2025
- 2024Memory Efficient Matting with Adaptive Token Routing14 Dec 2024
- 2024ZIM: Zero-Shot Image Matting for Anything1 Nov 2024
- 2024DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios13 Oct 2024
- 2024Towards Natural Image Matting in the Wild via Real-Scenario Prior9 Oct 2024
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositing6 Sep 2024
- 2024Alfie: Democratising RGBA Image Generation With No 27 Aug 2024
- 2024Training Matting Models without Alpha Labels20 Aug 2024
- 2024LookupForensics: A Large-Scale Multi-Task Dataset for Multi-Phase Image-Based Fact Verification26 Jul 2024
- 2024FADE: A Task-Agnostic Upsampling Operator for Encoder-Decoder Architectures18 Jul 2024
- 2024Green Screen Augmentation Enables Scene Generalisation in Robotic Manipulation10 Jul 2024
- 2024MaGGIe: Masked Guided Gradual Human Instance Matting24 Apr 2024
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generation3 Apr 2024
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting28 Mar 2024
- 2024In-Context Matting23 Mar 2024
- 2024Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Model17 Mar 2024
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation10 Mar 2024
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?10 Mar 2024
50 newest of 150 All 150 (JSON)
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 37
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentationcited by 29
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learningcited by 8
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceiverscited by 5
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2
- 2024Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Modelcited by 2
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformer10 Dec 2025
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers24 Nov 2025
- 2025SDMatte: Grafting Diffusion Models for Interactive Matting1 Aug 2025
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning12 Jul 2025
- 2024Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Model17 Mar 2024
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?10 Mar 2024
- 2024Transparent Image Layer Diffusion using Latent Transparency27 Feb 2024
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learning22 Nov 2023
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Model19 Jul 2023
- 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentation22 Mar 2023
- 2021Concealed Object Detectioncited by 212
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 102
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Semantic Image Mattingcited by 55
- 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
12 most cited of 139 All 139 (JSON)
- 2026Overpainting: Localized Context-aware Diffusion Image Editing9 Sep 2026
- 2026RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting9 Aug 2026
- 2026Self-supervised Automatic Matting11 Jul 2026
- 2026OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal26 Jun 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026Generating Humanless Environment Walkthroughs from Egocentric Walking Tour Videos30 Mar 2026
- 2026Segment and Matte Anything in a Unified Model17 Jan 2026
- 2026Toward Real-World High-Precision Image Matting and Segmentation17 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025Rectifying Latent Space for Generative Single-Image Reflection Removal6 Dec 2025
12 newest of 139 All 139 (JSON)