GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editing
Not on the map. Why?
Abstract (arXiv)
While Diffusion Large Language Models (DLLMs) have demonstrated remarkable capabilities in multi-modal generation, performing precise, training-free image editing remains an open challenge. Unlike continuous diffusion models, the discrete tokenization inherent in DLLMs hinders the application of standard noise inversion techniques, often leading to structural degradation during editing. In this paper, we introduce GIDE (Grounded Inversion for DLLM Image Editing), a unified framework designed to bridge this gap. GIDE incorporates a novel Discrete Noise Inversion mechanism that accurately captures latent noise patterns within the discrete token space, ensuring high-fidelity reconstruction. We then decompose the editing pipeline into grounding, inversion, and refinement stages. This design enables GIDE supporting various editing instructions (text, point and box) and operations while strictly preserving the unedited background. Furthermore, to overcome the limitations of existing single-step evaluation protocols, we introduce GIDE-Bench, a rigorous benchmark comprising 805 compositional editing scenarios guided by diverse multi-modal inputs. Extensive experiments on GIDE-Bench demonstrate that GIDE significantly outperforms prior training-free methods, improving Semantic Correctness by 51.83% and Perceptual Quality by 50.39%. Additional evaluations on ImgEdit-Bench confirm its broad applicability, demonstrating consistent gains over trained baselines and yielding photorealistic consistency on par with leading models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 66 of its 75 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
66 of 75 references.
References · 66
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
38 more
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2025Large Language Diffusion Modelscited by 872
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 148
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 128
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2025LongCat-Image Technical Reportcited by 92
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 89
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 52
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
- 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 42
- 2024One Diffusion to Generate Them Allcited by 41
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Inversion-Free Image Editing with Natural Language
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2026Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing
- 2024Specify and Edit: Overcoming Ambiguity in Text-Based Image Editing
- 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps
- 2024TurboEdit: Instant text-based image editing