IRPO: Boosting Image Restoration via Post-training GRPO
Not on the map. Why?
Abstract (arXiv)
Post-training has become effective for high-level generation, but its role in low-level vision remains underexplored. Existing image restoration methods often rely on fixed pixel-wise fitting to ground-truth images, which can lead to over-smoothing and weak generalization. We propose IRPO, a GRPO-based post-training framework for deterministic restoration models. IRPO is built around two axes: data formulation and reward modeling. For data formulation, we select the 30% underperforming samples from the pre-training stage, which improves both accuracy and training efficiency. For reward modeling, we combine fidelity-oriented and quality-aware feedback with three components: a General Reward for structural fidelity, an Expert Reward that uses a Vision-Language Model as a coarse visual-quality judge, and a Restoration Reward for task-specific low-level cues. Experiments on six in-domain and five out-of-domain (OOD) benchmarks show that IRPO improves the AdaIR baseline by 0.93 dB on in-domain tasks and 3.43 dB on OOD settings. Our code can be shown in https://github.com/HaoxuanXU1024/IRPO.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 70 of its 94 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
70 of 94 references.
References · 70
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
38 more
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2022Simple Baselines for Image Restorationcited by 701
- 2017The Perception-Distortion Tradeoffcited by 582
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2021Post-Training Quantization for Vision Transformercited by 274
- 2022Post-training Quantization on Diffusion Modelscited by 262
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022VRT: A Video Restoration Transformercited by 219
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
- 2020FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazingcited by 79
- 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
- 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 70
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Test-Time Preference Optimization for Image Restoration
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement
- 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration
- 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restoration
- 2024Boosting Image Restoration via Priors from Pre-trained Models
- 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
- 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback