CODE: Confident Ordinary Differential Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Conditioning image generation facilitates seamless editing and the creation of photorealistic images. However, conditioning on noisy or Out-of-Distribution (OoD) images poses significant challenges, particularly in balancing fidelity to the input and realism of the output. We introduce Confident Ordinary Differential Editing (CODE), a novel approach for image synthesis that effectively handles OoD guidance images. Utilizing a diffusion model as a generative prior, CODE enhances images through score-based updates along the probability-flow Ordinary Differential Equation (ODE) trajectory. This method requires no task-specific training, no handcrafted modules, and no assumptions regarding the corruptions affecting the conditioning image. Our method is compatible with any diffusion model. Positioned at the intersection of conditional image generation and blind image restoration, CODE operates in a fully blind manner, relying solely on a pre-trained generative model. Our method introduces an alternative approach to blind restoration: instead of targeting a specific ground truth image based on assumptions about the underlying corruption, CODE aims to increase the likelihood of the input image while maintaining fidelity. This results in the most probable in-distribution image around the input. Our contributions are twofold. First, CODE introduces a novel editing method based on ODE, providing enhanced control, realism, and fidelity compared to its SDE-based counterpart. Second, we introduce a confidence interval-based clipping method, which improves CODE's effectiveness by allowing it to disregard certain pixels or information, thus enhancing the restoration process in a blind manner. Experimental results demonstrate CODE's effectiveness over existing methods, particularly in scenarios involving severe degradation or OoD inputs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 41 of its 50 references that are in the map. First posted on arXiv 22 Aug 2024.
Builds on
41 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2017Neural Discrete Representation Learningcited by 4,650
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
28 more
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
- 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
- 2023Direct Diffusion Bridge using Data Consistency for Inverse Problemscited by 65
- 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
- 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidancecited by 49
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
- 2024Editable Image Elements for Controllable Synthesis
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing
- 2025Guidance Free Image Editing via Explicit Conditioning
- 2024TurboEdit: Instant text-based image editing
- 2023Filter-Guided Diffusion for Controllable Image Generation
- 2023High-Fidelity Diffusion-based Image Editing
- 2022On Conditioning the Input Noise for Controlled Image Generation with Diffusion Models