mlsanityData to 14 Oct 2026

RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation

arXiv 2509.23480 ↗First posted 27 Sep 2025cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

also in 1 more
Abstract (arXiv)

Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to students, but existing static feature matching methods cannot capture how modern transformer architectures dynamically generate features. We propose a novel Latent Rectified Flow Feature Distillation method for restoring degraded images called 'RestoRect'. We apply rectified flow to reformulate feature distillation as a generative process where students learn to synthesize teacher-quality features through learnable trajectories in latent space. Our framework combines Retinex decomposition with learnable anisotropic diffusion constraints, and trigonometric color space polarization. We introduce a Feature Layer Extraction loss for robust knowledge transfer between different network architectures through cross-normalized transformer feature alignment with percentile-based outlier detection. RestoRect achieves better training stability, and faster convergence and inference while preserving restoration quality, demonstrating superior results across 15 image restoration datasets, covering 4 tasks, on 10 metrics against baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 51 of its 79 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

51 of 79 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model20 Nov
  2. 2023Global Structure-Aware Diffusion Process for Low-Light Image Enhancement26 Oct
  3. 2023Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model25 Aug
  4. 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar

Other references · 47

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  6. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  7. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  8. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  9. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  10. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  11. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
35 more
  1. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  2. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 542
  3. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  4. 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
  5. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  6. 2019A Comprehensive Overhaul of Feature Distillationcited by 348
  7. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 332
  8. 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
  9. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 253
  10. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
  11. 2021Low-Light Image Enhancement with Normalizing Flowcited by 185
  12. 2018Getting to Know Low-light Images with The Exclusively Dark Datasetcited by 157
  13. 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
  14. 2021U-shape Transformer for Underwater Image Enhancementcited by 112
  15. 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
  16. 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistencycited by 104
  17. 2021Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understandingcited by 97
  18. 2022LEDNet: Joint Low-light Enhancement and Deblurring in the Darkcited by 96
  19. 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
  20. 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
  21. 2022Knowledge Distillation via the Target-aware Transformercited by 70
  22. 2022Underwater Ranker: Learn Which Is Better and How to Be Bettercited by 67
  23. 2023FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Informationcited by 64
  24. 2022Uncertainty Inspired Underwater Image Enhancementcited by 54
  25. 2023PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminatorscited by 49
  26. 2021Shallow-UWnet : Compressed Model for Underwater Image Enhancementcited by 35
  27. 2023Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Networkcited by 33
  28. 2024You Only Need One Color Space: An Efficient Network for Low-light Image Enhancementcited by 24
  29. 2023Empowering Low-Light Image Enhancer through Customized Learnable Priorscited by 22
  30. 2025UnfoldIR: Rethinking Deep Unfolding Network in Illumination Degradation Image Restorationcited by 22
  31. 2024Boosting Latent Diffusion with Perceptual Objectivescited by 20
  32. 2022Low-Light Image and Video Enhancement: A Comprehensive Survey and Beyondcited by 17
  33. 2024RAVE: Residual Vector Embedding for CLIP-Guided Backlit Image Enhancementcited by 11
  34. 2025Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barrierscited by 3
  35. 2025HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancementcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images
  2. 2024Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
  3. 2025Reversing Flow for Image Restoration
  4. 2026In-Token Learning for High-Fidelity Image Restoration via Diffusion Transformers
  5. 2025Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression
  6. 2025Defense against Unauthorized Distillation in Image Restoration via Feature Space Perturbation
  7. 2026IR-Flow: Bridging Discriminative and Generative Image Restoration via Rectified Flow
  8. 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformer