h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
We introduce a theoretical framework for diffusion-based image editing by formulating it as a reverse-time bridge modeling problem. This approach modifies the backward process of a pretrained diffusion model to construct a bridge that converges to an implicit distribution associated with the editing target at time 0. Building on this framework, we propose h-Edit, a novel editing method that utilizes Doob's h-transform and Langevin Monte Carlo to decompose the update of an intermediate edited sample into two components: a "reconstruction" term and an "editing" term. This decomposition provides flexibility, allowing the reconstruction term to be computed via existing inversion techniques and enabling the combination of multiple editing terms to handle complex editing tasks. To our knowledge, h-Edit is the first training-free method capable of performing simultaneous text-guided and reward-model-based editing. Extensive experiments, both quantitative and qualitative, show that h-Edit outperforms state-of-the-art baselines in terms of editing effectiveness and faithfulness. Our source code is available at https://github.com/nktoan/h-edit.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 64 of its 87 references that are in the map. First posted on arXiv 4 Mar 2025.
Builds on
64 of 87 references.
Closest ancestors · 22
Same direction, newest first
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb
- 2024Noise Map Guidance: Inversion with Spatial Context for Real Image Editing7 Feb
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models26 May
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models8 May
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulations12 Apr
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing28 Mar
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec
10 more
- 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Models8 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022Compositional Visual Generation with Composable Diffusion Models3 Jun
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models16 May
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
- 2021Palette: Image-to-Image Diffusion Models10 Nov
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct
Other references · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
30 more
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2023Universal Guidance for Diffusion Modelscited by 426
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 256
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023Denoising Diffusion Bridge Modelscited by 171
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Modelscited by 102
- 2023Simulation-free Schr"odinger bridges via score and flow matchingcited by 81
- 2023Aligned Diffusion Schr"odinger Bridgescited by 38
- 2025Bidirectional Diffusion Bridge Modelscited by 8
- 2022Face Swapping as A Simple Arithmetic Operationcited by 3
- 2024Variational Flow Models: Flowing in Your Stylecited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 14.
18 papers.
Sort:
By area:
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learningcited by 7
- 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transformcited by 6
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editingcited by 5
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 1
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversioncited by 1
- 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generationcited by 1
- 2026GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editingcited by 1
- 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidancecited by 1
- 2026Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resourcecited by 1
- 2025Score Replacement with Bounded Deviation for Rare Prompt Generationcited by 0
- 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometrycited by 0
6 more
- 2026Robust SDE Parameter Estimation Under Missing Time Information Settingcited by 0
- 2026Infinite-dimensional generative diffusions via Doob's h-transformcited by 0
- 2026Dynamic Frequency Modulation for Controllable Text-driven Image Generationcited by 0
- 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steeringcited by 0
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Imagescited by 0
- 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transformcited by 0
- 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transform12 Jul 2026
- 2026Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource8 Jul 2026
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Images10 Jun 2026
- 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidance17 Apr 2026
- 2026GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editing22 Mar 2026
- 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation10 Mar 2026
- 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steering7 Mar 2026
- 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transform18 Feb 2026
- 2026Dynamic Frequency Modulation for Controllable Text-driven Image Generation11 Feb 2026
- 2026Infinite-dimensional generative diffusions via Doob's h-transform6 Feb 2026
- 2026Robust SDE Parameter Estimation Under Missing Time Information Setting28 Jan 2026
- 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometry25 Jan 2026
6 more
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion4 Jan 2026
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignment22 Nov 2025
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learning11 Nov 2025
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing3 Jun 2025
- 2025Score Replacement with Bounded Deviation for Rare Prompt Generation27 May 2025
- 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transformcited by 6
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editingcited by 5
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversioncited by 1
- 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generationcited by 1
- 2025Score Replacement with Bounded Deviation for Rare Prompt Generationcited by 0
- 2026Infinite-dimensional generative diffusions via Doob's h-transformcited by 0
- 2026Dynamic Frequency Modulation for Controllable Text-driven Image Generationcited by 0
- 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steeringcited by 0
- 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation10 Mar 2026
- 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steering7 Mar 2026
- 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transform18 Feb 2026
- 2026Dynamic Frequency Modulation for Controllable Text-driven Image Generation11 Feb 2026
- 2026Infinite-dimensional generative diffusions via Doob's h-transform6 Feb 2026
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion4 Jan 2026
- 2025DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing3 Jun 2025
- 2025Score Replacement with Bounded Deviation for Rare Prompt Generation27 May 2025
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learningcited by 7
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 1
- 2026GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editingcited by 1
- 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidancecited by 1
- 2026Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resourcecited by 1
- 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometrycited by 0
- 2026Robust SDE Parameter Estimation Under Missing Time Information Settingcited by 0
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Imagescited by 0
- 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transformcited by 0
- 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transform12 Jul 2026
- 2026Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource8 Jul 2026
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Images10 Jun 2026
- 2026From Competition to Coopetition: Coopetitive Training-Free Image Editing Based on Text Guidance17 Apr 2026
- 2026GIDE: Unlocking Diffusion LLMs for Precise Training-Free Image Editing22 Mar 2026
- 2026Robust SDE Parameter Estimation Under Missing Time Information Setting28 Jan 2026
- 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometry25 Jan 2026
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignment22 Nov 2025
- 2025LayerEdit: Disentangled Multi-Object Editing via Conflict-Aware Multi-Layer Learning11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2023High-Fidelity Diffusion-based Image Editing
- 2025Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2025Image Editing with Diffusion Models: A Survey
- 2024FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models
- 2026Stable and Near-Reversible Diffusion ODE Solvers for Image Editing
- 2024TurboEdit: Instant text-based image editing
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models