mlsanityData to 7 Oct 2026

TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models

arXiv 2408.00735 ↗First posted 1 Aug 2024cs.CV cs.GRcited by 64

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models have opened the path to a wide range of text-based image editing frameworks. However, these typically build on the multi-step nature of the diffusion backwards process, and adapting them to distilled, fast-sampling methods has proven surprisingly challenging. Here, we focus on a popular line of text-based editing frameworks - the ``edit-friendly'' DDPM-noise inversion approach. We analyze its application to fast sampling methods and categorize its failures into two classes: the appearance of visual artifacts, and insufficient editing strength. We trace the artifacts to mismatched noise statistics between inverted noises and the expected noise schedule, and suggest a shifted noise schedule which corrects for this offset. To increase editing strength, we propose a pseudo-guidance approach that efficiently increases the magnitude of edits without introducing new artifacts. All in all, our method enables text-based image editing with as few as three diffusion steps, while providing novel insights into the mechanisms behind popular text-based editing approaches.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 48 of its 67 references that are in the map. First posted on arXiv 1 Aug 2024.

Builds on

48 of 67 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalization4 Apr
  2. 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
  3. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
  4. 2023LEDITS: Real Image Editing with DDPM Inversion and Semantic Guidance2 Jul
  5. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  6. 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models25 May
  7. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  8. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  10. 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  12. 2022Blended Latent Diffusion6 Jun
2 more
  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
22 more
  1. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  2. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  5. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  6. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  7. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  8. 2023Zero-shot Image-to-Image Translationcited by 503
  9. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  10. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  11. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  12. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  13. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  14. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  15. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  16. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  17. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
  18. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  19. 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
  20. 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
  21. 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
  22. 2024Unified Diffusion-Based Rigid and Non-Rigid Editing with Text and Image Guidancecited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 31; 2026: 22.

64 papers.

Sort:

By area:

  1. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  2. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
  3. 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editingcited by 66
  4. 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 42
  5. 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusioncited by 28
  6. 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
  7. 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Modelscited by 24
  8. 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 22
  9. 2025ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motionscited by 19
  10. 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
  11. 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 17
  12. 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformationscited by 15
38 more
  1. 2024InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attentioncited by 13
  2. 2025Learning an Image Editing Model without Image Editing Pairscited by 13
  3. 2024Instruction-based Image Manipulation by Watching How Things Movecited by 11
  4. 2025WeatherEdit: Controllable Weather Editing with 4D Gaussian Fieldcited by 11
  5. 2025Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flowcited by 10
  6. 2024PostEdit: Posterior Sampling for Efficient Zero-Shot Image Editingcited by 9
  7. 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fieldscited by 8
  8. 2025SAEdit: Token-level control for continuous image editing via Sparse AutoEncodercited by 8
  9. 2025PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Modelscited by 7
  10. 2025Tight Inversion: Image-Conditioned Inversion for Real Image Editingcited by 7
  11. 2025In-Context Brush: Zero-shot Customized Subject Insertion with Context-Aware Latent Space Manipulationcited by 7
  12. 2025InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flowcited by 7
  13. 2024Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulationcited by 6
  14. 2025Describe, Don't Dictate: Semantic Image Editing with Natural Language Intentcited by 6
  15. 2025Personalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimizationcited by 6
  16. 2025Cora: Correspondence-aware image editing using few step diffusioncited by 5
  17. 2025OmniRefiner: Reinforcement-Guided Local Diffusion Refinementcited by 5
  18. 2025NullFace: Training-Free Localized Face Anonymizationcited by 4
  19. 2025POEM: Precise Object-level Editing via MLLM controlcited by 4
  20. 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
  21. 2025FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editingcited by 4
  22. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  23. 2026Spanning the Visual Analogy Space with a Weight Basis of LoRAscited by 4
  24. 2025DFVEdit: Conditional Delta Flow Vector for Zero-shot Video Editingcited by 3
  25. 2025Stable Score Distillationcited by 3
  26. 2025FreeCus: Free Lunch Subject-driven Customization in Diffusion Transformerscited by 3
  27. 2026Tuning-free Visual Effect Transfer across Videoscited by 3
  28. 2025CPAM: Context-Preserving Adaptive Manipulation for Zero-Shot Real Image Editingcited by 2
  29. 2025AGSwap: Overcoming Category Boundaries in Object Fusion via Adaptive Group Swappingcited by 2
  30. 2026WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather Transformationcited by 2
  31. 2026Training-free image inversion for one-step diffusion modelscited by 2
  32. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
  33. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editingcited by 2
  34. 2025Reference-free Human-Object Interaction Editingcited by 1
  35. 2025SPF-Portrait: Towards Pure Text-to-Portrait Customization with Semantic Pollution-Free Fine-Tuningcited by 1
  36. 2025Teaching Humans Subtle Differences with DIFFusioncited by 1
  37. 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Modelscited by 1
  38. 20253D-Consistent Multi-View Editing by Correspondence Guidancecited by 1

50 most cited of 64 All 64 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
  2. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  3. 2023Inversion-Free Image Editing with Natural Language
  4. 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing
  5. 2024TurboEdit: Instant text-based image editing
  6. 2025Editable Noise Map Inversion: Encoding Target-image into Noise For High-Fidelity Image Manipulation
  7. 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing
  8. 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing