mlsanityData to 7 Oct 2026

Wavelet-Guided Acceleration of Text Inversion in Diffusion-Based Image Editing

arXiv 2401.09794 ↗First posted 18 Jan 2024cs.CVcited by 12

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In the field of image editing, Null-text Inversion (NTI) enables fine-grained editing while preserving the structure of the original image by optimizing null embeddings during the DDIM sampling process. However, the NTI process is time-consuming, taking more than two minutes per image. To address this, we introduce an innovative method that maintains the principles of the NTI while accelerating the image editing process. We propose the WaveOpt-Estimator, which determines the text optimization endpoint based on frequency characteristics. Utilizing wavelet transform analysis to identify the image's frequency characteristics, we can limit text optimization to specific timesteps during the DDIM sampling process. By adopting the Negative-Prompt Inversion (NPI) concept, a target prompt representing the original image serves as the initial text value for optimization. This approach maintains performance comparable to NTI while reducing the average editing time by over 80% compared to the NTI method. Our method presents a promising approach for efficient, high-quality image editing based on diffusion models.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 19 of its 20 references that are in the map. First posted on arXiv 18 Jan 2024.

Builds on

19 of 20 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  2. 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing28 Mar
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 11

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  9. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  10. 2017Generative Adversarial Networks: An Overviewcited by 588
  11. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 5; 2026: 1.

12 papers.

  1. 2024C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersioncited by 82
  2. 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editingcited by 31
  3. 2024FRAG: Frequency Adapting Group for Diffusion Video Editingcited by 15
  4. 2024DNI: Dilutional Noise Initialization for Diffusion Video Editingcited by 12
  5. 2024TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animationcited by 12
  6. 2024BI-MDRG: Bridging Image History in Multimodal Dialogue Response Generationcited by 8
  7. 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fieldscited by 8
  8. 2025MoEdit: On Learning Quantity Perception for Multi-object Image Editingcited by 7
  9. 2025Occlusion-robust Stylization for Drawing-based 3D Animationcited by 3
  10. 2025Prompting without Panic: Attribute-aware, Zero-shot, Test-Time Calibrationcited by 2
  11. 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communicationscited by 1
  12. 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance
  2. 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing
  3. 2024SimInversion: A Simple Framework for Inversion-Based Text-to-Image Editing
  4. 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing
  5. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  6. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models
  7. 2024TurboEdit: Instant text-based image editing
  8. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models