mlsanityData to 14 Oct 2026

GuidPaint: Class-Guided Image Inpainting with Diffusion Models

arXiv 2507.21627 ↗First posted 29 Jul 2025cs.CVcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

In recent years, diffusion models have been widely adopted for image inpainting tasks due to their powerful generative capabilities, achieving impressive results. Existing multimodal inpainting methods based on diffusion models often require architectural modifications and retraining, resulting in high computational cost. In contrast, context-aware diffusion inpainting methods leverage the model's inherent priors to adjust intermediate denoising steps, enabling high-quality inpainting without additional training and significantly reducing computation. However, these methods lack fine-grained control over the masked regions, often leading to semantically inconsistent or visually implausible content. To address this issue, we propose GuidPaint, a training-free, class-guided image inpainting framework. By incorporating classifier guidance into the denoising process, GuidPaint enables precise control over intermediate generations within the masked areas, ensuring both semantic consistency and visual realism. Furthermore, it integrates stochastic and deterministic sampling, allowing users to select preferred intermediate results and deterministically refine them. Experimental results demonstrate that GuidPaint achieves clear improvements over existing context-aware inpainting methods in both qualitative and quantitative evaluations.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 41 of its 45 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

41 of 45 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024RAD: Region-Aware Diffusion Models for Image Inpainting12 Dec
  2. 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting29 Mar
  3. 2023Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models6 Apr
  4. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model9 Dec
  5. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
  6. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
23 more
  1. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  3. 2022Video Diffusion Modelscited by 2,305
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  5. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  6. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  7. 2022Denoising Diffusion Restoration Modelscited by 963
  8. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  9. 2016Pixel Recurrent Neural Networkscited by 816
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  11. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  12. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
  13. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  14. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  15. 2022Blended Latent Diffusioncited by 432
  16. 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
  17. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
  18. 2016Semantic Image Inpainting with Deep Generative Modelscited by 157
  19. 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
  20. 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
  21. 2020Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizationscited by 102
  22. 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
  23. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 59

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model
  2. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion
  3. 20243D-Consistent Image Inpainting with Diffusion Models
  4. 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them First
  5. 2024Diffusion-based image inpainting with internal learning
  6. 2024PainterNet: Adaptive Image Inpainting with Actual-Token Attention and Diverse Mask Control
  7. 2024Coherent and Multi-modality Image Inpainting via Latent Space Optimization
  8. 2023Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models