Language-Free Generative Editing from One Visual Example
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-guided diffusion models have advanced image editing by enabling intuitive control through language. However, despite their strong capabilities, we surprisingly find that SOTA methods struggle with simple, everyday transformations such as rain or blur. We attribute this limitation to weak and inconsistent textual supervision during training, which leads to poor alignment between language and vision. Existing solutions often rely on extra finetuning or stronger text conditioning, but suffer from high data and computational requirements. We argue that diffusion-based editing capabilities aren't lost but merely hidden from text. The door to cost-efficient visual editing remains open, and the key lies in a vision-centric paradigm that perceives and reasons about visual change as humans do, beyond words. Inspired by this, we introduce Visual Diffusion Conditioning (VDC), a training-free framework that learns conditioning signals directly from visual examples for precise, language-free image editing. Given a paired example -one image with and one without the target effect- VDC derives a visual condition that captures the transformation and steers generation through a novel condition-steering mechanism. An accompanying inversion-correction step mitigates reconstruction errors during DDIM inversion, preserving fine detail and realism. Across diverse tasks, VDC outperforms both training-free and fully fine-tuned text-based editing methods. The code and models are open-sourced at https://omaralezaby.github.io/vdc/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 68 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
61 of 68 references.
Closest ancestors · 16
Same direction, newest first
- 2025ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation2 Jul
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025Difference Inversion: Interpolate and Isolate the Difference with Token Consistency for Image Analogy Generation9 Jun
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
- 2024Taming Rectified Flow for Inversion and Editing7 Nov
- 2024OmniGen: Unified Image Generation17 Sep
- 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Model16 May
- 2023Inversion-Free Image Editing with Natural Language7 Dec
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code2 Oct
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
4 more
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance10 Dec
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
33 more
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2023Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistencycited by 180
- 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealingcited by 157
- 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Modelscited by 156
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2023Regularization by Texts for Latent Diffusion Inverse Solverscited by 31
- 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
- 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editingcited by 10
- 2025PairEdit: Learning Semantic Variations for Exemplar-based Image Editingcited by 8
- 2025EditCLIP: Representation Learning for Image Editingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
- 2026EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing
- 2023Visual Instruction Inversion: Image Editing via Visual Prompting
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
- 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2025EditInfinity: Image Editing with Binary-Quantized Generative Models