Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-conditional image editing is a practical AIGC task that has recently emerged with great commercial and academic value. For real image editing, most diffusion model-based methods use DDIM Inversion as the first stage before editing. However, DDIM Inversion often results in reconstruction failure, leading to unsatisfactory performance for downstream editing. To address this problem, we first analyze why the reconstruction via DDIM Inversion fails. We then propose a new inversion and sampling method named Dual-Schedule Inversion. We also design a classifier to adaptively combine Dual-Schedule Inversion with different editing methods for user-friendly image editing. Our work can achieve superior reconstruction and editing performance with the following advantages: 1) It can reconstruct real images perfectly without fine-tuning, and its reversibility is guaranteed mathematically. 2) The edited object/scene conforms to the semantics of the text prompt. 3) The unedited parts of the object/scene retain the original identity.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 15 Dec 2024.
Builds on
50 of 59 references.
Closest ancestors · 22
Same direction, newest first
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models17 Oct
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization15 Feb
- 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing7 Feb
- 2023ZONE: Zero-Shot Instruction-Guided Local Editing28 Dec
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models11 Dec
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code2 Oct
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention17 May
10 more
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
16 more
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
- 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 62
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 47
- 2023On Exact Inversion of DPM-Solverscited by 47
- 2023KV Inversion: KV Embeddings Learning for Text-Conditioned Real Image Action Editingcited by 22
- 2024Doubly Abductive Counterfactual Inference for Text-based Image Editingcited by 13
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generationcited by 8
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistencycited by 7
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?cited by 3
- 2026Semantic Granularity Navigation in Image Editingcited by 1
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulationcited by 1
- 2026LAMS-Edit: Latent and Attention Mixing with Schedulers for Improved Content Preservation in Diffusion-Based Image and Style Editingcited by 0
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulation10 Sep 2026
- 2026Semantic Granularity Navigation in Image Editing20 May 2026
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generation13 Apr 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modeling22 Jan 2026
- 2026LAMS-Edit: Latent and Attention Mixing with Schedulers for Improved Content Preservation in Diffusion-Based Image and Style Editing6 Jan 2026
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency27 Oct 2025
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?29 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing
- 2024SimInversion: A Simple Framework for Inversion-Based Text-to-Image Editing
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
- 2023Tuning-Free Inversion-Enhanced Control for Consistent Image Editing
- 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models
- 2023Inversion-Free Image Editing with Natural Language
- 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editing
- 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models