Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting
Not on the map. Why?
Abstract (arXiv)
We study the composition style in deep image matting, a notion that characterizes a data generation flow on how to exploit limited foregrounds and random backgrounds to form a training dataset. Prior art executes this flow in a completely random manner by simply going through the foreground pool or by optionally combining two foregrounds before foreground-background composition. In this work, we first show that naive foreground combination can be problematic and therefore derive an alternative formulation to reasonably combine foregrounds. Our second contribution is an observation that matting performance can benefit from a certain occurrence frequency of combined foregrounds and their associated source foregrounds during training. Inspired by this, we introduce a novel composition style that binds the source and combined foregrounds in a definite triplet. In addition, we also find that different orders of foreground combination lead to different foreground patterns, which further inspires a quadruplet-based composition style. Results under controlled experiments on four matting baselines show that our composition styles outperform existing ones and invite consistent performance improvement on both composited and real-world datasets. Code is available at: https://github.com/coconuthust/composition_styles
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 27 Dec 2022.
Builds on
13 of 21 references.
References · 13
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2017Deep Image Mattingcited by 150
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2020Learning Affinity-Aware Upsampling for Deep Image Mattingcited by 37
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.