mlsanityData to 7 Oct 2026

Language-Free Generative Editing from One Visual Example

arXiv 2603.25441 ↗First posted 26 Mar 2026eess.IVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-guided diffusion models have advanced image editing by enabling intuitive control through language. However, despite their strong capabilities, we surprisingly find that SOTA methods struggle with simple, everyday transformations such as rain or blur. We attribute this limitation to weak and inconsistent textual supervision during training, which leads to poor alignment between language and vision. Existing solutions often rely on extra finetuning or stronger text conditioning, but suffer from high data and computational requirements. We argue that diffusion-based editing capabilities aren't lost but merely hidden from text. The door to cost-efficient visual editing remains open, and the key lies in a vision-centric paradigm that perceives and reasons about visual change as humans do, beyond words. Inspired by this, we introduce Visual Diffusion Conditioning (VDC), a training-free framework that learns conditioning signals directly from visual examples for precise, language-free image editing. Given a paired example -one image with and one without the target effect- VDC derives a visual condition that captures the transformation and steers generation through a novel condition-steering mechanism. An accompanying inversion-correction step mitigates reconstruction errors during DDIM inversion, preserving fine detail and realism. Across diverse tasks, VDC outperforms both training-free and fully fine-tuned text-based editing methods. The code and models are open-sourced at https://omaralezaby.github.io/vdc/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 68 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

61 of 68 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation2 Jul
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  3. 2025Difference Inversion: Interpolate and Isolate the Difference with Token Consistency for Image Analogy Generation9 Jun
  4. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
  5. 2024Taming Rectified Flow for Inversion and Editing7 Nov
  6. 2024OmniGen: Unified Image Generation17 Sep
  7. 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Model16 May
  8. 2023Inversion-Free Image Editing with Natural Language7 Dec
  9. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code2 Oct
  10. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
4 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  2. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  4. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance10 Dec

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
33 more
  1. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  5. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  6. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  7. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  8. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  9. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  10. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  11. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
  12. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  13. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  14. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  15. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  16. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  17. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
  18. 2023Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistencycited by 180
  19. 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealingcited by 157
  20. 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Modelscited by 156
  21. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  22. 2021Image-to-Image Translation: Methods and Applicationscited by 116
  23. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  24. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  25. 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
  26. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
  27. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
  28. 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
  29. 2023Regularization by Texts for Latent Diffusion Inverse Solverscited by 31
  30. 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
  31. 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editingcited by 10
  32. 2025PairEdit: Learning Semantic Variations for Exemplar-based Image Editingcited by 8
  33. 2025EditCLIP: Representation Learning for Image Editingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
  2. 2026EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing
  3. 2023Visual Instruction Inversion: Image Editing via Visual Prompting
  4. 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
  5. 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
  6. 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
  7. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  8. 2025EditInfinity: Image Editing with Binary-Quantized Generative Models