mlsanityData to 14 Oct 2026

Disentangling Generation and Regression in Stochastic Interpolants for Controllable Image Restoration

arXiv 2605.21381 ↗First posted 20 May 2026cs.CV cs.LGcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Recent advances in Image Restoration (IR) have been largely driven by generative methods such as Diffusion Models and Flow Matching, which excel in synthesizing realistic textures while suffering from slow multi-step inference and compromised pixel fidelity. In contrast, classical regression-based IR methods excel precisely in these aspects, offering single-step efficiency and high pixel-level reconstruction fidelity. To bridge this gap, we propose DiSI, a unified framework that Disentangles the underlying Stochastic Interpolant process into independent generation and regression components. This decoupling endows DiSI with remarkable versatility, enabling a continuous and controllable transition from a pure regression process to a fully generative one. Technically, we instantiate this framework with two specific sampling trajectories, accompanied by a unified sampler for high-quality, few-step inference on arbitrary trajectories. Furthermore, we design a dual-branch U-Net style transformer network in pixel space, using a dedicated branch to enhance conditional guidance while ensuring high throughput. Extensive experiments demonstrate that DiSI efficiently achieves competitive results on various IR tasks, while uniquely offering the inference-time flexibility to control the distortion-perception trade-off within a single model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 93 of its 105 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

93 of 105 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Efficient Image Restoration with State-Dependent Forward Diffusion22 May
  2. 2024Are Conditional Latent Diffusion Models Effective for Image Restoration?12 Dec
  3. 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge16 Dec
  4. 2023Residual Denoising Diffusion Models25 Aug
  5. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey18 Aug
  6. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
  7. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
  8. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models17 Apr
  9. 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar
  10. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  11. 2022Denoising Diffusion Restoration Models27 Jan

Other references · 82

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2022Flow Matching for Generative Modelingcited by 5,702
  11. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  12. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2018Neural Ordinary Differential Equationscited by 3,779
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  13. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  14. 2023Consistency Modelscited by 1,822
  15. 2020GLU Variants Improve Transformercited by 1,804
  16. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  17. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  18. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  19. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  20. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  21. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  22. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  23. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  24. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
  25. 2022Diffusion Models in Vision: A Surveycited by 1,015
  26. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  27. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  28. 2020Pre-Trained Image Processing Transformercited by 893
  29. 2021Multi-Stage Progressive Image Restorationcited by 816
  30. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  31. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  32. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  33. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  34. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
  35. 2017The Perception-Distortion Tradeoffcited by 587
  36. 2025Mean Flows for One-step Generative Modelingcited by 561
  37. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  38. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402

50 most cited of 82 All 82 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior
  2. 2026IR-Flow: Bridging Discriminative and Generative Image Restoration via Rectified Flow
  3. 2026Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution
  4. 2023A Unified Conditional Framework for Diffusion-based Image Restoration
  5. 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
  6. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration
  7. 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models
  8. 2026Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention