mlsanityData to 7 Oct 2026

RePaint: Inpainting using Denoising Diffusion Probabilistic Models

arXiv 2201.09865 ↗First posted 24 Jan 2022cs.CVcited by 1,419

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Free-form inpainting is the task of adding new content to an image in the regions specified by an arbitrary binary mask. Most existing approaches train for a certain distribution of masks, which limits their generalization capabilities to unseen mask types. Furthermore, training with pixel-wise and perceptual losses often leads to simple textural extensions towards the missing areas instead of semantically meaningful generation. In this work, we propose RePaint: A Denoising Diffusion Probabilistic Model (DDPM) based inpainting approach that is applicable to even extreme masks. We employ a pretrained unconditional DDPM as the generative prior. To condition the generation process, we only alter the reverse diffusion iterations by sampling the unmasked regions using the given image information. Since this technique does not modify or condition the original DDPM network itself, the model produces high-quality and diverse output images for any inpainting form. We validate our method for both faces and general-purpose image inpainting using standard and extreme masks. RePaint outperforms state-of-the-art Autoregressive, and GAN approaches for at least five out of six mask distributions. Github Repository: git.io/RePaint

Key facts. Cited by 1,419 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 41 of its 60 references that are in the map. First posted on arXiv 24 Jan 2022.

Builds on

41 of 60 references.

References · 41

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  11. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
29 more
  1. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  2. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  4. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  5. 2017Deep Image Priorcited by 1,097
  6. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  7. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  8. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  9. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  10. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  11. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  12. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  13. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  14. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
  15. 2019Pluralistic Image Completioncited by 162
  16. 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
  17. 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
  18. 2019StructureFlow: Image Inpainting via Structure-aware Appearance Flowcited by 118
  19. 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
  20. 2020Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizationscited by 102
  21. 2019Learning Pyramid-Context Encoder Network for High-Quality Image Inpaintingcited by 94
  22. 2019Foreground-aware Image Inpaintingcited by 90
  23. 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
  24. 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
  25. 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
  26. 2020SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objectscited by 43
  27. 2018Learning Hierarchical Semantic Image Manipulation through Structured Representationscited by 27
  28. 2020Image Fine-grained Inpaintingcited by 16
  29. 2020AIM 2020 Challenge on Image Extreme Inpaintingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 92; 2023: 402; 2024: 390; 2025: 355; 2026: 180.

1,419 papers.

Sort:

By area:

  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  3. 2022Diffusion Models in Vision: A Surveycited by 1,008
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  5. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  7. 2023Extracting Training Data from Diffusion Modelscited by 723
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  10. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  11. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  12. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
38 more
  1. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  2. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  3. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  4. 2022Blended Latent Diffusioncited by 430
  5. 2023Universal Guidance for Diffusion Modelscited by 426
  6. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  7. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  8. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
  9. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  10. 2023Human Motion Diffusion as a Generative Priorcited by 354
  11. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
  12. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  13. 2022Is synthetic data from generative models ready for image recognition?cited by 320
  14. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  15. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
  16. 2022EDGE: Editable Dance Generation From Musiccited by 284
  17. 2023Effective Data Augmentation With Diffusion Modelscited by 282
  18. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
  19. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  20. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  21. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
  22. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
  23. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  24. 2022A Survey on Generative Diffusion Modelcited by 238
  25. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  26. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  27. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  28. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  29. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  30. 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Modelscited by 218
  31. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  32. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 213
  33. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  34. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  35. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  36. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  37. 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
  38. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197

50 most cited of 1,419 All 1,419 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Minutes to Seconds: Speeded-up DDPM-based Image Inpainting with Coarse-to-Fine Sampling
  2. 20243D-Consistent Image Inpainting with Diffusion Models
  3. 2021Learning Sparse Masks for Diffusion-based Image Inpainting
  4. 2024Coherent and Multi-modality Image Inpainting via Latent Space Optimization
  5. 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting
  6. 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them First
  7. 2025InpDiffusion: Image Inpainting Localization via Conditional Diffusion Models
  8. 2025DiffuEraser: A Diffusion Model for Video Inpainting