mlsanityData to 7 Oct 2026

CODE: Confident Ordinary Differential Editing

arXiv 2408.12418 ↗First posted 22 Aug 2024cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Conditioning image generation facilitates seamless editing and the creation of photorealistic images. However, conditioning on noisy or Out-of-Distribution (OoD) images poses significant challenges, particularly in balancing fidelity to the input and realism of the output. We introduce Confident Ordinary Differential Editing (CODE), a novel approach for image synthesis that effectively handles OoD guidance images. Utilizing a diffusion model as a generative prior, CODE enhances images through score-based updates along the probability-flow Ordinary Differential Equation (ODE) trajectory. This method requires no task-specific training, no handcrafted modules, and no assumptions regarding the corruptions affecting the conditioning image. Our method is compatible with any diffusion model. Positioned at the intersection of conditional image generation and blind image restoration, CODE operates in a fully blind manner, relying solely on a pre-trained generative model. Our method introduces an alternative approach to blind restoration: instead of targeting a specific ground truth image based on assumptions about the underlying corruption, CODE aims to increase the likelihood of the input image while maintaining fidelity. This results in the most probable in-distribution image around the input. Our contributions are twofold. First, CODE introduces a novel editing method based on ODE, providing enhanced control, realism, and fidelity compared to its SDE-based counterpart. Second, we introduce a confidence interval-based clipping method, which improves CODE's effectiveness by allowing it to disregard certain pixels or information, thus enhancing the restoration process in a blind manner. Experimental results demonstrate CODE's effectiveness over existing methods, particularly in scenarios involving severe degradation or OoD inputs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 41 of its 50 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

41 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models16 May

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  11. 2014Conditional Generative Adversarial Netscited by 2,152
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
28 more
  1. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  3. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  4. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  5. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  6. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  7. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  8. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  9. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  12. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  13. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  14. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
  15. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
  16. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
  17. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  18. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
  19. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  20. 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
  21. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  22. 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
  23. 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
  24. 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
  25. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
  26. 2023Direct Diffusion Bridge using Data Consistency for Inverse Problemscited by 65
  27. 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
  28. 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidancecited by 49

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code
  2. 2024Editable Image Elements for Controllable Synthesis
  3. 2026On the Controllability-Fidelity Frontier in Diffusion Editing
  4. 2025Guidance Free Image Editing via Explicit Conditioning
  5. 2024TurboEdit: Instant text-based image editing
  6. 2023Filter-Guided Diffusion for Controllable Image Generation
  7. 2023High-Fidelity Diffusion-based Image Editing
  8. 2022On Conditioning the Input Noise for Controlled Image Generation with Diffusion Models