SpecEdit: Training-Free Acceleration for Diffusion based Image Editing via Semantic Locking
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing early steps at reduced resolution. However, existing approaches prioritize upsampling using low-level heuristics such as edge detection or channel variance, which are weakly aligned with editing semantics and may lead to structural inconsistency. Moreover, spatial regions are often upsampled without verifying whether semantic modification is actually required, resulting in redundant high-resolution computation and accumulated errors. Therefore, we propose SpecEdit, a training-free dynamic-resolution framework tailored for diffusion-based image editing. SpecEdit follows a draft-and-verify scheme: a low-resolution draft first estimates the semantic outcome, after which token-level discrepancies are used to identify edit-relevant tokens for high-resolution denoising, while the remaining tokens stay at a coarse resolution. Experiments on Qwen-Image-Edit and FLUX.1-Kontext-dev demonstrate up to 10x and 7x acceleration, while maintaining strong quality. SpecEdit is complementary to step distillation and other acceleration techniques, achieving up to 13x speedup when combined with existing methods. Our code is in supplementary material and will be released on GitHub.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 31 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
27 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025SpotEdit: Selective Region Editing in Diffusion Transformers26 Dec
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
Other references · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2025Qwen-Image Technical Reportcited by 973
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
12 more
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
- 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 143
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 127
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
- 2025Training-free Diffusion Acceleration with Bottleneck Samplingcited by 25
- 2025Forecast then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformerscited by 23
- 2025FreqCa: Accelerating Diffusion Models via Frequency-Aware Cachingcited by 16
- 2025Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformerscited by 8
- 2026From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolutioncited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing
- 2026EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model
- 2023High-Fidelity Diffusion-based Image Editing
- 2026Diffusion Image Editing via Asynchronous Token Decoding
- 2023Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inference
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing
- 2024Streamlining Image Editing with Layered Diffusion Brushes
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs