Highly Efficient Natural Image Matting
Not on the map. Why?
Abstract (arXiv)
Over the last few years, deep learning based approaches have achieved outstanding improvements in natural image matting. However, there are still two drawbacks that impede the widespread application of image matting: the reliance on user-provided trimaps and the heavy model sizes. In this paper, we propose a trimap-free natural image matting method with a lightweight model. With a lightweight basic convolution block, we build a two-stages framework: Segmentation Network (SN) is designed to capture sufficient semantics and classify the pixels into unknown, foreground and background regions; Matting Refine Network (MRN) aims at capturing detailed texture information and regressing accurate alpha values. With the proposed cross-level fusion Module (CFM), SN can efficiently utilize multi-scale features with less computational cost. Efficient non-local attention module (ENA) in MRN can efficiently model the relevance between different pixels and help regress high-quality alpha values. Utilizing these techniques, we construct an extremely light-weighted model, which achieves comparable performance with ~1% parameters (344k) of large models on popular natural image matting benchmarks.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 25 Oct 2021.
Builds on
30 of 55 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2017Non-local Neural Networkscited by 2,293
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
- 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
- 2020Real-Time High-Resolution Background Mattingcited by 173
- 2017Deep Image Mattingcited by 150
- 2019Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolutioncited by 140
18 more
- 2020Background Matting: The World is Your Green Screencited by 105
- 2019Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translationcited by 97
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2020XingGAN for Person Image Generationcited by 81
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2019AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networkscited by 77
- 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
- 2018Semantic Human Mattingcited by 67
- 2017Information-Flow Mattingcited by 59
- 2018AlphaGAN: Generative adversarial networks for natural image mattingcited by 50
- 2019Disentangled Image Mattingcited by 47
- 2020Dual Attention GANs for Semantic Image Synthesiscited by 41
- 2021Disentangled High Quality Salient Object Detectioncited by 35
- 2020Bipartite Graph Reasoning GANs for Person Image Generationcited by 34
- 2017Fast Deep Matting for Portrait Animation on Mobile Phonecited by 30
- 2019Instance Segmentation based Semantic Matting for Compositing Applicationscited by 7
- 2020CLASS: Cross-Level Attention and Supervision for Salient Objects Detectioncited by 7
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 1.
6 papers.
- 2022Federated Learning with Label Distribution Skew via Logits Calibrationcited by 109
- 2022Towards Practical Certifiable Patch Defense with Vision Transformercited by 44
- 2023Deep Image Matting: A Comprehensive Surveycited by 12
- 2023Scene Matters: Model-based Deep Video Compressioncited by 6
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Mattingcited by 3
- 2022Disentangle Saliency Detection into Cascaded Detail Modeling and Body Fillingcited by 1
- 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting1 Apr 2024
- 2023Deep Image Matting: A Comprehensive Survey10 Apr 2023
- 2023Scene Matters: Model-based Deep Video Compression8 Mar 2023
- 2022Federated Learning with Label Distribution Skew via Logits Calibration1 Sep 2022
- 2022Towards Practical Certifiable Patch Defense with Vision Transformer16 Mar 2022
- 2022Disentangle Saliency Detection into Cascaded Detail Modeling and Body Filling8 Feb 2022