Image inpainting: A review
Not on the map. Why?
Abstract (arXiv)
Although image inpainting, or the art of repairing the old and deteriorated images, has been around for many years, it has gained even more popularity because of the recent development in image processing techniques. With the improvement of image processing tools and the flexibility of digital image editing, automatic image inpainting has found important applications in computer vision and has also become an important and challenging topic of research in image processing. This paper is a brief review of the existing image inpainting approaches we first present a global vision on the existing methods for image inpainting. We attempt to collect most of the existing approaches and classify them into three categories, namely, sequential-based, CNN-based and GAN-based methods. In addition, for each category, a list of methods for the different types of distortion on the images is presented. Furthermore, collect a list of the available datasets and discuss these in our paper. This is a contribution for digital image inpainting researchers trying to look for the available datasets because there is a lack of datasets available for image inpainting. As the final step in this overview, we present the results of real evaluations of the three categories of image inpainting methods performed on the datasets used, for the different types of image distortion. In the end, we also present the evaluations metrics and discuss the performance of these methods in terms of these metrics. This overview can be used as a reference for image inpainting researchers, and it can also facilitate the comparison of the methods as well as the datasets used. The main contribution of this paper is the presentation of the three categories of image inpainting methods along with a list of available datasets that the researchers can use to evaluate their proposed methodology against.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 14; 2023: 21; 2024: 18; 2025: 19; 2026: 6.
89 papers.
Sort:
By area:
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2021ReSSL: Relational Self-Supervised Learning with Weak Augmentationcited by 83
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2021Weakly Supervised Contrastive Learningcited by 81
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2023GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fieldscited by 26
- 2021Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenescited by 25
- 2021The Piano Inpainting Applicationcited by 23
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2021JPGNet: Joint Predictive Filtering and Generative Network for Image Inpaintingcited by 17
- 2022Learning Prior Feature and Attention Enhanced Image Inpaintingcited by 16
38 more
- 2023Mask-conditioned latent diffusion for generating gastrointestinal polyp imagescited by 16
- 2025Whitened CLIP as a Likelihood Surrogate of Images and Captionscited by 16
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
- 2023Robust Unsupervised StyleGAN Image Restorationcited by 14
- 2021Seeing Through Clouds in Satellite Imagescited by 13
- 2021A Kinematic Bottleneck Approach For Pose Regression of Flexible Surgical Instruments directly from Imagescited by 11
- 2022Generative Adversarial Networks for Image Super-Resolution: A Surveycited by 11
- 2022Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detectioncited by 11
- 2024Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstructioncited by 11
- 2023SketchFFusion: Sketch-guided image editing with diffusion modelcited by 8
- 2024DISCO: Language-Guided Manipulation with Diffusion Policies and Constrained Inpaintingcited by 8
- 2024Semantic Aware Diffusion Inverse Tone Mappingcited by 7
- 2024Transformer-based Image and Video Inpainting: Current Challenges and Future Directionscited by 6
- 2025An LLM-LVLM Driven Agent for Iterative and Fine-Grained Image Editingcited by 6
- 2023TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Modelscited by 5
- 2023Saliency-Guided Hidden Associative Replay for Continual Learningcited by 5
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusioncited by 5
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problemscited by 5
- 2025Enhancing Diffusion Model Stability for Image Restoration via Gradient Managementcited by 5
- 2021Reconstructing occluded Elevation Information in Terrain Maps with Self-supervised Learningcited by 4
- 2021Fully Context-Aware Image Inpainting with a Learned Semantic Pyramidcited by 4
- 2023Dequantization and Color Transfer with Diffusion Modelscited by 4
- 2023DLSIA: Deep Learning for Scientific Image Analysiscited by 4
- 2025Towards Improved Text-Aligned Codebook Learning: Multi-Hierarchical Codebook-Text Alignment with Long Textcited by 4
- 2022Weak Augmentation Guided Relational Self-Supervised Learningcited by 3
- 2023AutoPaint: A Self-Inpainting Method for Unsupervised Anomaly Detectioncited by 3
- 2023RIC: Rotate-Inpaint-Complete for Generalizable Scene Reconstructioncited by 3
- 2024Self-Supervised Learning for Text Recognition: A Critical Surveycited by 3
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasoundcited by 3
- 2025UGoDIT: Unsupervised Group Deep Image Prior Via Transferable Weightscited by 3
- 2025High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic detailscited by 3
- 2023Deep image prior inpainting of ancient frescoes in the Mediterranean Alpine arccited by 2
- 2024EngineBench: Flow Reconstruction in the Transparent Combustion Chamber III Optical Enginecited by 2
- 2024Subtractive Training for Music Stem Insertion using Latent Diffusion Modelscited by 2
- 2021Foreground-guided Facial Inpainting with Fidelity Preservationcited by 1
- 2021Viscos Flows: Variational Schur Conditional Sampling With Normalizing Flowscited by 1
- 2022RSINet: Inpainting Remotely Sensed Images Using Triple GAN Frameworkcited by 1
- 2022Unsupervised Discovery of Semantic Concepts in Satellite Imagery with Style-based Wavelet-driven Generative Modelscited by 1
50 most cited of 89 All 89 (JSON)
- 2026Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation25 Sep 2026
- 2026Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models9 Sep 2026
- 2026Image Inpainting via Stochastic Dynamics27 Jul 2026
- 2026Reconstructing Randomly Masked Spectra Helps DNNs Identify Discriminant Wavenumbers19 Jun 2026
- 2026Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data1 Feb 2026
- 2026Diffusion for De-Occlusion: Accessory-Aware Diffusion Inpainting for Robust Ear Biometric Recognition27 Jan 2026
- 2025Anomaly detection in satellite imagery through temporal inpainting30 Dec 2025
- 2025What Shape Is Optimal for Masks in Text Removal?27 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025Vector-based loss functions for turbulent flow field inpainting6 Sep 2025
- 2025User Manual for Model-based Imaging Inverse Problem1 Sep 2025
- 2025An LLM-LVLM Driven Agent for Iterative and Fine-Grained Image Editing24 Aug 2025
38 more
- 2025Anatomic Feature Fusion Model for Diagnosing Calcified Pulmonary Nodules on Chest X-Ray18 Aug 2025
- 2025High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic details24 Jul 2025
- 2025Enhancing Diffusion Model Stability for Image Restoration via Gradient Management9 Jul 2025
- 2025Single Image Inpainting and Super-Resolution with Simultaneous Uncertainty Guarantees by Universal Reproducing Kernels29 Jun 2025
- 2025Geological Field Restoration through the Lens of Image Inpainting5 Jun 2025
- 2025UGoDIT: Unsupervised Group Deep Image Prior Via Transferable Weights16 May 2025
- 2025Whitened CLIP as a Likelihood Surrogate of Images and Captions11 May 2025
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problems10 May 2025
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Review5 Apr 2025
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpainting1 Apr 2025
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasound26 Mar 2025
- 2025In the Blink of an Eye: Instant Game Map Editing using a Generative-AI Smart Brush25 Mar 2025
- 2025Towards Improved Text-Aligned Codebook Learning: Multi-Hierarchical Codebook-Text Alignment with Long Text3 Mar 2025
- 2024NeRF Inpainting with Geometric Diffusion Prior and Balanced Score Distillation23 Nov 2024
- 2024Local Lesion Generation is Effective for Capsule Endoscopy Image Data Augmentation in a Limited Data Setting5 Nov 2024
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions23 Sep 2024
- 2024LOID: Lane Occlusion Inpainting and Detection for Enhanced Autonomous Driving Systems17 Aug 2024
- 2024Fire Dynamic Vision: Image Segmentation and Tracking for Multi-Scale Fire and Plume Behavior16 Aug 2024
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024
- 2024Music Proofreading with RefinPaint: Where and How to Modify Compositions given Context12 Jul 2024
- 2024M^3:Manipulation Mask Manufacturer for Arbitrary-Scale Super-Resolution Mask4 Jul 2024
- 2024Transformer-based Image and Video Inpainting: Current Challenges and Future Directions28 Jun 2024
- 2024Subtractive Training for Music Stem Insertion using Latent Diffusion Models27 Jun 2024
- 2024DISCO: Language-Guided Manipulation with Diffusion Policies and Constrained Inpainting14 Jun 2024
- 2024EngineBench: Flow Reconstruction in the Transparent Combustion Chamber III Optical Engine5 Jun 2024
- 2024Semantic Aware Diffusion Inverse Tone Mapping24 May 2024
- 2024Multi-scale Semantic Prior Features Guided Deep Neural Network for Urban Street-view Image17 May 2024
- 2024Towards Realistic Landmark-Guided Facial Video Inpainting Based on GANs14 Feb 2024
- 2024Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction6 Feb 2024
- 2024Deep Learning-based Image and Video Inpainting: A Survey7 Jan 2024
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion6 Jan 2024
- 2023Images in Discrete Choice Modeling: Addressing Data Isomorphism in Multi-Modality Inputs22 Dec 2023
- 2023AutoVisual Fusion Suite: A Comprehensive Evaluation of Image Segmentation and Voice Conversion Tools on HuggingFace Platform17 Dec 2023
- 2023FERGI: Automatic Scoring of User Preferences for Text-to-Image Generation from Spontaneous Facial Expression Reaction5 Dec 2023
- 2023Saliency-Guided Hidden Associative Replay for Continual Learning6 Oct 2023
- 2023TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Models20 Sep 2023
- 2023Reconstructing Existing Levels through Level Inpainting18 Sep 2023
- 2023Online Overexposed Pixels Hallucination in Videos with Adaptive Reference Frame Selection29 Aug 2023
50 newest of 89 All 89 (JSON)
- 2023Mask-conditioned latent diffusion for generating gastrointestinal polyp imagescited by 16
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
- 2023SketchFFusion: Sketch-guided image editing with diffusion modelcited by 8
- 2024DISCO: Language-Guided Manipulation with Diffusion Policies and Constrained Inpaintingcited by 8
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusioncited by 5
- 2025Enhancing Diffusion Model Stability for Image Restoration via Gradient Managementcited by 5
- 2023Dequantization and Color Transfer with Diffusion Modelscited by 4
- 2024Subtractive Training for Music Stem Insertion using Latent Diffusion Modelscited by 2
- 2024NeRF Inpainting with Geometric Diffusion Prior and Balanced Score Distillationcited by 1
- 2025Enhancing Diffusion Model Stability for Image Restoration via Gradient Management9 Jul 2025
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpainting1 Apr 2025
- 2024NeRF Inpainting with Geometric Diffusion Prior and Balanced Score Distillation23 Nov 2024
- 2024Subtractive Training for Music Stem Insertion using Latent Diffusion Models27 Jun 2024
- 2024DISCO: Language-Guided Manipulation with Diffusion Policies and Constrained Inpainting14 Jun 2024
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion6 Jan 2024
- 2023Dequantization and Color Transfer with Diffusion Models6 Jul 2023
- 2023Mask-conditioned latent diffusion for generating gastrointestinal polyp images11 Apr 2023
- 2023SketchFFusion: Sketch-guided image editing with diffusion model6 Apr 2023
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2021ReSSL: Relational Self-Supervised Learning with Weak Augmentationcited by 83
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2021Weakly Supervised Contrastive Learningcited by 81
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2023GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fieldscited by 26
- 2021Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenescited by 25
- 2021The Piano Inpainting Applicationcited by 23
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2021JPGNet: Joint Predictive Filtering and Generative Network for Image Inpaintingcited by 17
- 2022Learning Prior Feature and Attention Enhanced Image Inpaintingcited by 16
12 most cited of 79 All 79 (JSON)
- 2026Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation25 Sep 2026
- 2026Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models9 Sep 2026
- 2026Image Inpainting via Stochastic Dynamics27 Jul 2026
- 2026Reconstructing Randomly Masked Spectra Helps DNNs Identify Discriminant Wavenumbers19 Jun 2026
- 2026Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data1 Feb 2026
- 2026Diffusion for De-Occlusion: Accessory-Aware Diffusion Inpainting for Robust Ear Biometric Recognition27 Jan 2026
- 2025Anomaly detection in satellite imagery through temporal inpainting30 Dec 2025
- 2025What Shape Is Optimal for Masks in Text Removal?27 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025Vector-based loss functions for turbulent flow field inpainting6 Sep 2025
- 2025User Manual for Model-based Imaging Inverse Problem1 Sep 2025
- 2025Anatomic Feature Fusion Model for Diagnosing Calcified Pulmonary Nodules on Chest X-Ray18 Aug 2025
12 newest of 79 All 79 (JSON)