OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Aligning generative real-world image super-resolution models with human visual preference is challenging due to the perception--fidelity trade-off and diverse, unknown degradations. Prior approaches rely on offline preference optimization and static metric aggregation, which are often non-interpretable and prone to pseudo-diversity under strong conditioning. We propose OARS, a process-aware online alignment framework built on COMPASS, a MLLM-based reward that evaluates the LR to SR transition by jointly modeling fidelity preservation and perceptual gain with an input-quality-adaptive trade-off. To train COMPASS, we curate COMPASS-20K spanning synthetic and real degradations, and introduce a three-stage perceptual annotation pipeline that yields calibrated, fine-grained training labels. Guided by COMPASS, OARS performs progressive online alignment from cold-start flow matching to full-reference and finally reference-free RL via shallow LoRA optimization for on-policy exploration. Extensive experiments and user studies demonstrate consistent perceptual improvements while maintaining fidelity, achieving state-of-the-art performance on Real-ISR benchmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 60 of its 75 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
60 of 75 references.
Closest ancestors · 3
Same direction, newest first
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 57
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2025Qwen-Image Technical Reportcited by 973
38 more
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2013Stabilitycited by 119
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2024Tuning Language Models by Proxycited by 88
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 85
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2025One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillationcited by 40
- 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
- 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 34
- 2021Locally Adaptive Structure and Texture Similarity for Image Quality Assessmentcited by 32
- 2025Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Contentcited by 32
- 2025Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewardscited by 29
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
- 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
- 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
- 2026Spatial Gram Alignment for Ultra-High-Resolution Image Synthesis
- 2026LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution
- 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutions