Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical factors driving this capability remain underexplored in current research. Moreover, despite their superior performance, these models incur inference energy usage and latency orders of magnitude higher than their earlier counterparts, restricting their deployment in specific scenarios. Through extensive experiments, this paper verifies and elaborates that through RL training, MLLMs leverage their reasoning capability to convert redundant visual representations into compact, cross-domain aligned text representations. This conversion is precisely the source of the generalization exhibited by these reasoning-based IQA models. Building on this fundamental insight, we propose a novel algorithm, RALI, which employs contrastive learning to directly align images with these generalizable text representations learned by RL. This approach eliminates the reliance on reasoning processes and even obviates the need to load an LLM. For the quality scoring task, this framework achieves generalization performance comparable to reasoning-based models while requiring less than 5% of their model parameters and inference time.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 77 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
17 of 77 references.
Closest ancestors · 2
Same direction, newest first
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 119
- 2024o1-Coder: an o1 Replication for Codingcited by 78
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2025Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Contentcited by 32
3 more
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2025Q-SiT: Teaching LMMs for Image Quality Scoring and Interpretingcited by 13
- 2025AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detectioncited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 17.
18 papers.
Sort:
By area:
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoningcited by 6
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probingcited by 1
- 2026OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolutioncited by 1
- 2026One Model, Two Minds: Task-Conditioned Reasoning for Unified Image Quality and Aesthetic Assessmentcited by 1
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modelingcited by 1
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoningcited by 0
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thoughtcited by 0
6 more
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessmentcited by 0
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessmentcited by 0
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLMcited by 0
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessmentcited by 0
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removalcited by 0
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling19 Sep 2026
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment25 Aug 2026
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLM29 Jul 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment29 Jun 2026
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment20 May 2026
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment14 Apr 2026
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discovery7 Apr 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought24 Mar 2026
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning23 Mar 2026
6 more
- 2026One Model, Two Minds: Task-Conditioned Reasoning for Unified Image Quality and Aesthetic Assessment20 Mar 2026
- 2026OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution13 Mar 2026
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing21 Jan 2026
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning6 Jan 2026
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing5 Jan 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probingcited by 1
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessmentcited by 0
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment20 May 2026
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing21 Jan 2026
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing5 Jan 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessmentcited by 0
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLMcited by 0
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessmentcited by 0
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removalcited by 0
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment25 Aug 2026
- 2026SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLM29 Jul 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment29 Jun 2026
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment14 Apr 2026
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discovery7 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank
- 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
- 2026Multi-Granularity Reasoning for Image Quality Assessment via Attribute-Aware Reinforcement Learning to Rank
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
- 2026ME-IQA: Memory-Enhanced Image Quality Assessment via Re-Ranking
- 2026IQA-T1: Tool-based Visual Evidence Reasoning for Image Quality Assessment