mlsanityData to 14 Oct 2026

SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion

arXiv 2412.04301 ↗First posted 5 Dec 2024cs.CVcited by 28

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advances in text-guided image editing enable users to perform image edits through simple text inputs, leveraging the extensive priors of multi-step diffusion-based text-to-image models. However, these methods often fall short of the speed demands required for real-world and on-device applications due to the costly multi-step inversion and sampling process involved. In response to this, we introduce SwiftEdit, a simple yet highly efficient editing tool that achieve instant text-guided image editing (in 0.23s). The advancement of SwiftEdit lies in its two novel contributions: a one-step inversion framework that enables one-step image reconstruction via inversion and a mask-guided editing technique with our proposed attention rescaling mechanism to perform localized image editing. Extensive experiments are provided to demonstrate the effectiveness and efficiency of SwiftEdit. In particular, SwiftEdit enables instant text-guided image editing, which is extremely faster than previous multi-step methods (at least 50 times faster) while maintain a competitive performance in editing results. Our project page is at: https://swift-edit.github.io/

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 43 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

36 of 43 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
  2. 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps20 Jun
  3. 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar
  4. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation8 Dec
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  6. 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing28 Mar
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 28

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2023Consistency Modelscited by 1,822
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  8. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  9. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  10. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  11. 2023Adversarial Diffusion Distillationcited by 759
  12. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
16 more
  1. 2022On Distillation of Guided Diffusion Modelscited by 725
  2. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  3. 2023Zero-shot Image-to-Image Translationcited by 505
  4. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  5. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  6. 2021GAN Inversion: A Surveycited by 367
  7. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  8. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  9. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 205
  10. 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
  11. 2019Seeing What a GAN Cannot Generatecited by 148
  12. 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
  13. 2016Invertible Conditional GANs for image editingcited by 118
  14. 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teachercited by 45
  15. 2023CommonCanvas: An Open Diffusion Model Trained with Creative-Commons Imagescited by 16
  16. 2024FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image Editingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 21.

28 papers.

Sort:

By area:

  1. 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 18
  2. 2025MedEBench: Diagnosing Reliability in Text-Guided Medical Image Editingcited by 8
  3. 2025Dragging with Geometry: From Pixels to Geometry-Guided Image Editingcited by 5
  4. 2025DFVEdit: Conditional Delta Flow Vector for Zero-shot Video Editingcited by 4
  5. 2025FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editingcited by 4
  6. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  7. 2026DDiT: Dynamic Patch Scheduling for Efficient Diffusion Transformerscited by 4
  8. 2025Text-guided Controllable Diffusion for Realistic Camouflage Images Generationcited by 3
  9. 2025Semantic-Aware Reconstruction Error for Detecting AI-Generated Imagescited by 2
  10. 20253D-Consistent Multi-View Editing by Correspondence Guidancecited by 2
  11. 2026CASL: Concept-Aligned Sparse Latents for Interpreting Diffusion Modelscited by 2
  12. 2026InverFill: One-Step Inversion for Enhanced Few-Step Diffusion Inpaintingcited by 2
16 more
  1. 2026Training-free image inversion for one-step diffusion modelscited by 2
  2. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editingcited by 2
  3. 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversioncited by 1
  4. 2026FBSDiff++: Improved Frequency Band Substitution of Diffusion Features for Efficient and Highly Controllable Text-Driven Image-to-Image Translationcited by 1
  5. 2026TexEditor: Structure-Preserving Text-Driven Texture Editingcited by 1
  6. 2026BiFM: Bidirectional Flow Matching for Few-Step Image Editing and Generationcited by 1
  7. 2026Prompt-Guided Image Editing with Masked Logit Nudging in Visual Autoregressive Modelscited by 1
  8. 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidancecited by 1
  9. 2026Bridging the Manifold Gap: Riemannian Residual Line Search for One-Step Image Editingcited by 1
  10. 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulationcited by 1
  11. 2026EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Modelcited by 0
  12. 2026SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusioncited by 0
  13. 2026ResEdit: Residual embeddings for precise generative image editingcited by 0
  14. 2026Compression Asymmetry and Trajectory Binding in Noise-Anchored Diffusion Inversioncited by 0
  15. 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptationcited by 0
  16. 2026Beyond Temporal Smoothing: Spatial Energy Budgets Stabilize One-Step Diffusion Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flow
  2. 2024TurboEdit: Instant text-based image editing
  3. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
  4. 2023LEDITS++: Limitless Image Editing using Text-to-Image Models
  5. 2023Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inference
  6. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  7. 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
  8. 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing