mlsanityData to 7 Oct 2026

OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution

arXiv 2603.12811 ↗First posted 13 Mar 2026cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Aligning generative real-world image super-resolution models with human visual preference is challenging due to the perception--fidelity trade-off and diverse, unknown degradations. Prior approaches rely on offline preference optimization and static metric aggregation, which are often non-interpretable and prone to pseudo-diversity under strong conditioning. We propose OARS, a process-aware online alignment framework built on COMPASS, a MLLM-based reward that evaluates the LR to SR transition by jointly modeling fidelity preservation and perceptual gain with an input-quality-adaptive trade-off. To train COMPASS, we curate COMPASS-20K spanning synthetic and real degradations, and introduce a three-stage perceptual annotation pipeline that yields calibrated, fine-grained training labels. Guided by COMPASS, OARS performs progressive online alignment from cold-start flow matching to full-reference and finally reference-free RL via shallow LoRA optimization for on-policy exploration. Extensive experiments and user studies demonstrate consistent perceptual improvements while maintaining fidelity, achieving state-of-the-art performance on Real-ISR benchmarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 60 of its 75 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

60 of 75 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
  2. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  3. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 57

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  9. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  10. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  11. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  12. 2025Qwen-Image Technical Reportcited by 973
38 more
  1. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  2. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  3. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  5. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  6. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  7. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  9. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  10. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  11. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  12. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
  13. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  14. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  15. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
  16. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
  17. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
  18. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  19. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  20. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  21. 2013Stabilitycited by 119
  22. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  23. 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
  24. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  25. 2024Tuning Language Models by Proxycited by 88
  26. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 85
  27. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  28. 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
  29. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
  30. 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
  31. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  32. 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
  33. 2025One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillationcited by 40
  34. 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
  35. 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 34
  36. 2021Locally Adaptive Structure and Texture Similarity for Image Quality Assessmentcited by 32
  37. 2025Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Contentcited by 32
  38. 2025Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewardscited by 29

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
  2. 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
  3. 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
  4. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
  5. 2026Spatial Gram Alignment for Ultra-High-Resolution Image Synthesis
  6. 2026LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution
  7. 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution
  8. 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutions