mlsanityData to 7 Oct 2026

Semantic Photo Manipulation with a Generative Image Prior

arXiv 2005.07727 ↗First posted 15 May 2020cs.CV cs.GR cs.LGcited by 178

Not on the map. Why?

Cited by 25 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two reasons. First, it is hard for GANs to precisely reproduce an input image. Second, after manipulation, the newly synthesized pixels often do not fit the original image. In this paper, we address these issues by adapting the image prior learned by GANs to image statistics of an individual image. Our method can accurately reconstruct the input image and synthesize new content, consistent with the appearance of the input image. We demonstrate our interactive system on several semantic image editing tasks, including synthesizing new objects consistent with background, removing unwanted objects, and changing the appearance of an object. Quantitative and qualitative comparisons against several existing methods demonstrate the effectiveness of our method.

Key facts. Cited by 178 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 62; 2022: 47; 2023: 43; 2024: 18; 2025: 6; 2026: 2.

178 papers.

Sort:

By area:

  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  4. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  5. 2023Zero-shot Image-to-Image Translationcited by 503
  6. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  7. 2022Blended Latent Diffusioncited by 430
  8. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  9. 2022Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Modelscited by 379
  10. 2021GAN Inversion: A Surveycited by 366
  11. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
  12. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
38 more
  1. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  2. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  3. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
  4. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  5. 2021Editing Conditional Radiance Fieldscited by 222
  6. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  7. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
  8. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  9. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
  10. 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
  11. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  12. 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
  13. 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
  14. 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
  15. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  16. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  17. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
  18. 2021Paint by Wordcited by 107
  19. 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
  20. 2021Gradient Inversion with Generative Image Priorcited by 101
  21. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  22. 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
  23. 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
  24. 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
  25. 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
  26. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  27. 2024Adaptive Activation Steering: A Tuning-Free LLM Truthfulness Improvement Method for Diverse Hallucinations Categoriescited by 74
  28. 2021Unsupervised 3D Shape Completion through GAN Inversioncited by 70
  29. 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
  30. 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
  31. 2021GAN-Supervised Dense Visual Alignmentcited by 61
  32. 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
  33. 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
  34. 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
  35. 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
  36. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  37. 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
  38. 2021Ensembling with Deep Generative Viewscited by 53

50 most cited of 178 All 178 (JSON)