mlsanityData to 7 Oct 2026

h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform

arXiv 2503.02187 ↗First posted 4 Mar 2025cs.CVcited by 18

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We introduce a theoretical framework for diffusion-based image editing by formulating it as a reverse-time bridge modeling problem. This approach modifies the backward process of a pretrained diffusion model to construct a bridge that converges to an implicit distribution associated with the editing target at time 0. Building on this framework, we propose h-Edit, a novel editing method that utilizes Doob's h-transform and Langevin Monte Carlo to decompose the update of an intermediate edited sample into two components: a "reconstruction" term and an "editing" term. This decomposition provides flexibility, allowing the reconstruction term to be computed via existing inversion techniques and enabling the combination of multiple editing terms to handle complex editing tasks. To our knowledge, h-Edit is the first training-free method capable of performing simultaneous text-guided and reward-model-based editing. Extensive experiments, both quantitative and qualitative, show that h-Edit outperforms state-of-the-art baselines in terms of editing effectiveness and faithfulness. Our source code is available at https://github.com/nktoan/h-edit.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 64 of its 87 references that are in the map. First posted on arXiv 4 Mar 2025.

Builds on

64 of 87 references.

Closest ancestors · 22

Same direction, newest first

  1. 2024Diffusion Model-Based Image Editing: A Survey27 Feb
  2. 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing7 Feb
  3. 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
  4. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
  5. 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
  6. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
  7. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models8 May
  8. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
  9. 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing28 Mar
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  11. 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec
  12. 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec
10 more
  1. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
  5. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  7. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models16 May
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  9. 2021Palette: Image-to-Image Diffusion Models10 Nov
  10. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
30 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  7. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  8. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  9. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  10. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  11. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  12. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
  13. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  14. 2023Zero-shot Image-to-Image Translationcited by 503
  15. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  16. 2023Universal Guidance for Diffusion Modelscited by 426
  17. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  18. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  19. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
  20. 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
  21. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  22. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
  23. 2023Denoising Diffusion Bridge Modelscited by 171
  24. 2021One Shot Face Swapping on Megapixelscited by 105
  25. 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Modelscited by 102
  26. 2023Simulation-free Schr"odinger bridges via score and flow matchingcited by 81
  27. 2023Aligned Diffusion Schr"odinger Bridgescited by 38
  28. 2025Bidirectional Diffusion Bridge Modelscited by 8
  29. 2022Face Swapping as A Simple Arithmetic Operationcited by 3
  30. 2024Variational Flow Models: Flowing in Your Stylecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 14.

18 papers.

Sort:

By area:

  1. 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learningcited by 7
  2. 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transformcited by 6
  3. 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editingcited by 5
  4. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  5. 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 1
  6. 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversioncited by 1
  7. 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generationcited by 1
  8. 2026GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editingcited by 1
  9. 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidancecited by 1
  10. 2026Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resourcecited by 1
  11. 2025Score Replacement with Bounded Deviation for Rare Prompt Generationcited by 0
  12. 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometrycited by 0
6 more
  1. 2026Robust SDE Parameter Estimation Under Missing Time Information Settingcited by 0
  2. 2026Infinite-dimensional generative diffusions via Doob's h-transformcited by 0
  3. 2026Dynamic Frequency Modulation for Controllable Text-driven Image Generationcited by 0
  4. 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steeringcited by 0
  5. 2026HairPort: In-context 3D-aware Hair Import and Transfer for Imagescited by 0
  6. 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transformcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023High-Fidelity Diffusion-based Image Editing
  2. 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models
  3. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  4. 2025Image Editing with Diffusion Models: A Survey
  5. 2024FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models
  6. 2026Stable and Near-Reversible Diffusion ODE Solvers for Image Editing
  7. 2024TurboEdit: Instant text-based image editing
  8. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models