mlsanityData to 7 Oct 2026

Improving Image-to-Image Translation via a Rectified Flow Reformulation

arXiv 2603.20186 ↗First posted 20 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In this work, we propose Image-to-Image Rectified Flow Reformulation (I2I-RFR), a practical plug-in reformulation that recasts standard I2I regression networks as continuous-time transport models. While pixel-wise I2I regression is simple, stable, and easy to adapt across tasks, it often over-smooths ill-posed and multimodal targets, whereas generative alternatives often require additional components, task-specific tuning, and more complex training and inference pipelines. Our method augments the backbone input by channel-wise concatenation with a noise-corrupted version of the ground-truth target and optimizes a simple t-reweighted pixel loss. This objective admits a rectified-flow interpretation via an induced velocity field, enabling ODE-based progressive refinement at inference time while largely preserving the standard supervised training pipeline. In most cases, adopting I2I-RFR requires only expanding the input channels, and inference can be performed with a few explicit solver steps (e.g., 3 steps) without distillation. Extensive experiments across multiple image-to-image translation and video restoration tasks show that I2I-RFR generally improves performance across a wide range of tasks and backbones, with particularly clear gains in perceptual quality and detail preservation. Overall, I2I-RFR provides a lightweight way to incorporate continuous-time refinement into conventional I2I models without requiring a heavy generative pipeline.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 55 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

40 of 55 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models16 May
  2. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  11. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  12. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
26 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  4. 2017Non-local Neural Networkscited by 2,290
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  9. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  10. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  11. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  12. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  13. 2022Simple Baselines for Image Restorationcited by 701
  14. 2017The Perception-Distortion Tradeoffcited by 582
  15. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
  16. 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
  17. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  18. 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
  19. 2021U-shape Transformer for Underwater Image Enhancementcited by 110
  20. 2022LEDNet: Joint Low-light Enhancement and Deblurring in the Darkcited by 95
  21. 2016Places: An Image Database for Deep Scene Understandingcited by 76
  22. 2024DarkIR: Robust Low-Light Image Restorationcited by 48
  23. 2023Underwater Image Enhancement by Transformer-based Diffusion Model with Non-uniform Sampling for Skip Strategycited by 32
  24. 2022Bringing Old Films Back to Lifecited by 31
  25. 2023Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancementcited by 27
  26. 2024AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurringcited by 25

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation
  2. 2024Text-to-Image Rectified Flow as Plug-and-Play Priors
  3. 2024Taming Rectified Flow for Inversion and Editing
  4. 2024I-Max: Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers with Projected Flow
  5. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations
  6. 2024Diffusion Model Compression for Image-to-Image Translation
  7. 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methods
  8. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models