mlsanityData to 7 Oct 2026

Zero-shot Image-to-Image Translation

arXiv 2302.03027 ↗First posted 6 Feb 2023cs.CV cs.GR cs.LGcited by 503

Not on the map. Why?

Cited by 321 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Large-scale text-to-image generative models have shown their remarkable ability to synthesize diverse and high-quality images. However, it is still challenging to directly apply these models for editing real images for two reasons. First, it is hard for users to come up with a perfect text prompt that accurately describes every visual detail in the input image. Second, while existing models can introduce desirable changes in certain regions, they often dramatically alter the input content and introduce unexpected changes in unwanted regions. In this work, we propose pix2pix-zero, an image-to-image translation method that can preserve the content of the original image without manual prompting. We first automatically discover editing directions that reflect desired edits in the text embedding space. To preserve the general content structure after editing, we further propose cross-attention guidance, which aims to retain the cross-attention maps of the input image throughout the diffusion process. In addition, our method does not need additional training for these edits and can directly use the existing pre-trained text-to-image diffusion model. We conduct extensive experiments and show that our method outperforms existing and concurrent works for both real and synthetic image editing.

Key facts. Cited by 503 papers in the map (data through 7 Oct 2026). Builds on 66 of its 77 references that are in the map. First posted on arXiv 6 Feb 2023.

Builds on

66 of 77 references.

References · 66

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 2022Classifier-Free Diffusion Guidancecited by 5,717
38 more
  1. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  11. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  12. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  13. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  14. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  15. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  16. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  17. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  18. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  19. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  20. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  21. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  22. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  23. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  24. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  25. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  26. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  27. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  28. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  29. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  30. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  31. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  32. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  33. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  34. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  35. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  36. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  37. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  38. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 132; 2024: 189; 2025: 124; 2026: 58.

503 papers.

Sort:

By area:

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  3. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  4. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  5. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  6. 2023Emergent Correspondence from Image Diffusioncited by 437
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  8. 2023DIRE for Diffusion-Generated Image Detectioncited by 386
  9. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  10. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  11. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  12. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
38 more
  1. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  2. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  3. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  4. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
  5. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
  6. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
  7. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  8. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
  9. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
  10. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  11. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  12. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  13. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  14. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  15. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
  16. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 172
  17. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
  18. 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
  19. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 150
  20. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Modelscited by 148
  21. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  22. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  23. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  24. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
  25. 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 135
  26. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
  27. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  28. 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 134
  29. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  30. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
  31. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  32. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  33. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  34. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
  35. 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 121
  36. 2023Delta Denoising Scorecited by 120
  37. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  38. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114

50 most cited of 503 All 503 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Pix2Video: Video Editing using Image Diffusion
  2. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
  3. 2023BARET : Balanced Attention based Real image Editing driven by Target-text Inversion
  4. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
  5. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
  6. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  7. 2023Filter-Guided Diffusion for Controllable Image Generation
  8. 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models