AMICO: Amodal Instance Composition
Not on the map. Why?
Abstract (arXiv)
Image composition aims to blend multiple objects to form a harmonized image. Existing approaches often assume precisely segmented and intact objects. Such assumptions, however, are hard to satisfy in unconstrained scenarios. We present Amodal Instance Composition for compositing imperfect -- potentially incomplete and/or coarsely segmented -- objects onto a target image. We first develop object shape prediction and content completion modules to synthesize the amodal contents. We then propose a neural composition model to blend the objects seamlessly. Our primary technical novelty lies in using separate foreground/background representations and blending mask prediction to alleviate segmentation errors. Our results show state-of-the-art performance on public COCOA and KINS benchmarks and attain favorable visual results across diverse scenes. We demonstrate various image composition applications such as object insertion and de-occlusion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 59 references that are in the map. First posted on arXiv 11 Oct 2022.
Builds on
31 of 59 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 163
19 more
- 2019Pluralistic Image Completioncited by 162
- 2017Deep Image Mattingcited by 150
- 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 135
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2017Deep Image Harmonizationcited by 120
- 2015Semantic Amodal Segmentationcited by 103
- 2020Segmenting Transparent Objects in the Wildcited by 98
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2016High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesiscited by 90
- 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
- 2019Foreground-aware Image Inpaintingcited by 90
- 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
- 2019Deep Image Blendingcited by 62
- 2017Information-Flow Mattingcited by 59
- 2018SPG-Net: Segmentation Prediction and Guidance Network for Image Inpaintingcited by 58
- 2020Foreground-aware Semantic Representations for Image Harmonizationcited by 53
- 2020Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenescited by 43
- 2019Human Synthesis and Scene Compositingcited by 11
- 2018Compositional GAN: Learning Image-Conditional Binary Compositioncited by 1
Built on by
Not cited yet.