mlsanityData to 7 Oct 2026

An Analysis of Generative Methods for Multiple Image Inpainting

arXiv 2205.02146 ↗First posted 4 May 2022cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a unique solution. In this work, we focus on learning-based image completion methods for multiple and diverse inpainting which goal is to provide a set of distinct solutions for a given damaged image. These methods capitalize on the probabilistic nature of certain generative models to sample various solutions that coherently restore the missing content. Along the chapter, we will analyze the underlying theory and analyze the recent proposals for multiple inpainting. To investigate the pros and cons of each method, we present quantitative and qualitative comparisons, on common datasets, regarding both the quality and the diversity of the set of inpainted solutions. Our analysis allows us to identify the most successful generative strategies in both inpainting quality and inpainting diversity. This task is closely related to the learning of an accurate probability distribution of images. Depending on the dataset in use, the challenges that entail the training of such a model will be discussed through the analysis.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 131 references that are in the map. First posted on arXiv 4 May 2022.

Builds on

64 of 131 references.

References · 64

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2020End-to-End Object Detection with Transformerscited by 7,384
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2016Improved Techniques for Training GANscited by 2,938
  11. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  12. 2017Improved Training of Wasserstein GANscited by 2,223
38 more
  1. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  2. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  3. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  4. 2017Deep Image Priorcited by 1,097
  5. 2019An Introduction to Variational Autoencoderscited by 997
  6. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  7. 2016Pixel Recurrent Neural Networkscited by 814
  8. 2015Generating Sentences from a Continuous Spacecited by 607
  9. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  10. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  11. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  12. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  13. 2018A Note on the Inception Scorecited by 225
  14. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
  15. 2019Pluralistic Image Completioncited by 162
  16. 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 161
  17. 2016Semantic Image Inpainting with Deep Generative Modelscited by 156
  18. 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
  19. 2017PixelSNAIL: An Improved Autoregressive Generative Modelcited by 137
  20. 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
  21. 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
  22. 2019StructureFlow: Image Inpainting via Structure-aware Appearance Flowcited by 118
  23. 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
  24. 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
  25. 2020Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizationscited by 102
  26. 2019Coherent Semantic Attention for Image Inpaintingcited by 97
  27. 2019Learning Pyramid-Context Encoder Network for High-Quality Image Inpaintingcited by 94
  28. 2019Foreground-aware Image Inpaintingcited by 90
  29. 2016High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesiscited by 89
  30. 2021Colorization Transformercited by 89
  31. 2018Shift-Net: Image Inpainting via Deep Feature Rearrangementcited by 87
  32. 2018Image Inpainting via Generative Multi-column Convolutional Neural Networkscited by 81
  33. 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
  34. 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
  35. 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
  36. 2017Variational Approaches for Auto-Encoding Generative Adversarial Networkscited by 52
  37. 2017Pixel Recursive Super Resolutioncited by 44
  38. 2019E-LPIPS: Robust Perceptual Image Similarity via Random Transformation Ensemblescited by 44

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Deep image prior inpainting of ancient frescoes in the Mediterranean Alpine arccited by 2