mlsanityData to 14 Oct 2026

Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editing

arXiv 2412.11152 ↗First posted 15 Dec 2024cs.CVcited by 8

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-conditional image editing is a practical AIGC task that has recently emerged with great commercial and academic value. For real image editing, most diffusion model-based methods use DDIM Inversion as the first stage before editing. However, DDIM Inversion often results in reconstruction failure, leading to unsatisfactory performance for downstream editing. To address this problem, we first analyze why the reconstruction via DDIM Inversion fails. We then propose a new inversion and sampling method named Dual-Schedule Inversion. We also design a classifier to adaptively combine Dual-Schedule Inversion with different editing methods for user-friendly image editing. Our work can achieve superior reconstruction and editing performance with the following advantages: 1) It can reconstruct real images perfectly without fine-tuning, and its reversibility is guaranteed mathematically. 2) The edited object/scene conforms to the semantics of the text prompt. 3) The unedited parts of the object/scene retain the original identity.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 15 Dec 2024.

Builds on

50 of 59 references.

Closest ancestors · 22

Same direction, newest first

  1. 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models17 Oct
  2. 2024Diffusion Model-Based Image Editing: A Survey27 Feb
  3. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization15 Feb
  4. 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing7 Feb
  5. 2023ZONE: Zero-Shot Instruction-Guided Local Editing28 Dec
  6. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models11 Dec
  7. 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
  8. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code2 Oct
  9. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
  10. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
  11. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  12. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention17 May
10 more
  1. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  2. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  4. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  5. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  6. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  12. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
16 more
  1. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  2. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  5. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  6. 2023Zero-shot Image-to-Image Translationcited by 505
  7. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  8. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  9. 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
  10. 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 62
  11. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  12. 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
  13. 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 47
  14. 2023On Exact Inversion of DPM-Solverscited by 47
  15. 2023KV Inversion: KV Embeddings Learning for Text-Conditioned Real Image Action Editingcited by 22
  16. 2024Doubly Abductive Counterfactual Inference for Text-based Image Editingcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing
  2. 2024SimInversion: A Simple Framework for Inversion-Based Text-to-Image Editing
  3. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
  4. 2023Tuning-Free Inversion-Enhanced Control for Consistent Image Editing
  5. 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models
  6. 2023Inversion-Free Image Editing with Natural Language
  7. 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editing
  8. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models