RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation
On the map: Diffusion models → Inverse problems and image restoration
also in 1 more
Abstract (arXiv)
Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to students, but existing static feature matching methods cannot capture how modern transformer architectures dynamically generate features. We propose a novel Latent Rectified Flow Feature Distillation method for restoring degraded images called 'RestoRect'. We apply rectified flow to reformulate feature distillation as a generative process where students learn to synthesize teacher-quality features through learnable trajectories in latent space. Our framework combines Retinex decomposition with learnable anisotropic diffusion constraints, and trigonometric color space polarization. We introduce a Feature Layer Extraction loss for robust knowledge transfer between different network architectures through cross-normalized transformer feature alignment with percentile-based outlier detection. RestoRect achieves better training stability, and faster convergence and inference while preserving restoration quality, demonstrating superior results across 15 image restoration datasets, covering 4 tasks, on 10 metrics against baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 51 of its 79 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
51 of 79 references.
Closest ancestors · 4
Same direction, newest first
- 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model20 Nov
- 2023Global Structure-Aware Diffusion Process for Low-Light Image Enhancement26 Oct
- 2023Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model25 Aug
- 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar
Other references · 47
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
35 more
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 542
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
- 2019A Comprehensive Overhaul of Feature Distillationcited by 348
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 332
- 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 253
- 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
- 2021Low-Light Image Enhancement with Normalizing Flowcited by 185
- 2018Getting to Know Low-light Images with The Exclusively Dark Datasetcited by 157
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2021U-shape Transformer for Underwater Image Enhancementcited by 112
- 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
- 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistencycited by 104
- 2021Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understandingcited by 97
- 2022LEDNet: Joint Low-light Enhancement and Deblurring in the Darkcited by 96
- 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
- 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
- 2022Knowledge Distillation via the Target-aware Transformercited by 70
- 2022Underwater Ranker: Learn Which Is Better and How to Be Bettercited by 67
- 2023FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Informationcited by 64
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 54
- 2023PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminatorscited by 49
- 2021Shallow-UWnet : Compressed Model for Underwater Image Enhancementcited by 35
- 2023Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Networkcited by 33
- 2024You Only Need One Color Space: An Efficient Network for Low-light Image Enhancementcited by 24
- 2023Empowering Low-Light Image Enhancer through Customized Learnable Priorscited by 22
- 2025UnfoldIR: Rethinking Deep Unfolding Network in Illumination Degradation Image Restorationcited by 22
- 2024Boosting Latent Diffusion with Perceptual Objectivescited by 20
- 2022Low-Light Image and Video Enhancement: A Comprehensive Survey and Beyondcited by 17
- 2024RAVE: Residual Vector Embedding for CLIP-Guided Backlit Image Enhancementcited by 11
- 2025Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barrierscited by 3
- 2025HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancementcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images
- 2024Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
- 2025Reversing Flow for Image Restoration
- 2026In-Token Learning for High-Fidelity Image Restoration via Diffusion Transformers
- 2025Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression
- 2025Defense against Unauthorized Distillation in Image Restoration via Feature Space Perturbation
- 2026IR-Flow: Bridging Discriminative and Generative Image Restoration via Rectified Flow
- 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformer