mlsanityData to 7 Oct 2026

Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models

arXiv 2305.16807 ↗First posted 26 May 2023cs.CVcited by 172

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In image editing employing diffusion models, it is crucial to preserve the reconstruction fidelity to the original image while changing its style. Although existing methods ensure reconstruction fidelity through optimization, a drawback of these is the significant amount of time required for optimization. In this paper, we propose negative-prompt inversion, a method capable of achieving equivalent reconstruction solely through forward propagation without optimization, thereby enabling ultrafast editing processes. We experimentally demonstrate that the reconstruction fidelity of our method is comparable to that of existing methods, allowing for inversion at a resolution of 512 pixels and with 50 sampling steps within approximately 5 seconds, which is more than 30 times faster than null-text inversion. Reduction of the computation time by the proposed method further allows us to use a larger number of sampling steps in diffusion models to improve the reconstruction fidelity with a moderate increase in computation time.

Key facts. Cited by 172 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 31 of its 38 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

31 of 38 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb
  2. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  8. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
11 more
  1. 2022Video Diffusion Modelscited by 2,280
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  5. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  6. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  7. 2023Zero-shot Image-to-Image Translationcited by 503
  8. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  9. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  10. 2022Diffusion Models for Video Prediction and Infillingcited by 134
  11. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 15; 2024: 61; 2025: 60; 2026: 36.

172 papers.

Sort:

By area:

  1. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  2. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  3. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  4. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
  5. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  6. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
  7. 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 125
  8. 2023Inversion-Free Image Editing with Natural Languagecited by 106
  9. 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
  10. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 85
  11. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  12. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
38 more
  1. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
  2. 2024Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Modelscited by 62
  3. 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
  4. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
  5. 2023Posterior Distillation Samplingcited by 45
  6. 2024Score Distillation via Reparametrized DDIMcited by 41
  7. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
  8. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
  9. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 38
  10. 2023Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion Modelscited by 34
  11. 2024Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editingcited by 34
  12. 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
  13. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inferencecited by 33
  14. 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editingcited by 31
  15. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  16. 2024FineCLIPER: Multi-modal Fine-grained CLIP for Dynamic Facial Expression Recognition with AdaptERscited by 30
  17. 2023Object-aware Inversion and Reassembly for Image Editingcited by 29
  18. 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
  19. 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Modelscited by 29
  20. 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
  21. 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
  22. 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editingcited by 25
  23. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
  24. 2025DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editingcited by 22
  25. 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidancecited by 21
  26. 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Modelscited by 21
  27. 2025AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360deg Unbounded Scene Inpaintingcited by 21
  28. 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transformcited by 18
  29. 2025InPO: Inversion Preference Optimization with Reparametrized DDIM for Efficient Diffusion Model Alignmentcited by 18
  30. 2024Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editingcited by 17
  31. 2025Multi-turn Consistent Image Editingcited by 17
  32. 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
  33. 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
  34. 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 17
  35. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 16
  36. 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Stepscited by 14
  37. 2024Wavelet-Guided Acceleration of Text Inversion in Diffusion-Based Image Editingcited by 12
  38. 2024ProMoAI: Process Modeling with Generative AIcited by 12

50 most cited of 172 All 172 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024TurboEdit: Instant text-based image editing
  2. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
  3. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
  4. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion
  5. 2023High-Fidelity Diffusion-based Image Editing
  6. 2024Latent Inversion with Timestep-aware Sampling for Training-free Non-rigid Editing
  7. 2024MirrorDiffusion: Stabilizing Diffusion Process in Zero-shot Image Translation by Prompts Redescription and Beyond
  8. 2023Prompt-tuning latent diffusion models for inverse problems