Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as separate tasks with disjoint optimization objectives, leading to a trade-off: models adept at quality reasoning descriptions struggle with precise score regression, while score-focused models lack interpretability. This limitation hinders the full potential of MLLMs in visual quality assessment, where accuracy and interpretability should be mutually reinforcing. To address this, we propose a unified two-stage training framework comprising a cold-start stage and a reinforcement learning-based fine-tuning stage. Specifically, in the first stage, we distill high-quality data from a teacher model through expert-designed prompts, initializing reasoning capabilities via cross-entropy loss supervision. In the second stage, we introduce a novel reward with Group Relative Policy Optimization (GRPO) to jointly optimize scoring accuracy and reasoning consistency. We designate the models derived from these two stages as Q-Ponder-CI and Q-Ponder. Extensive experiments show that Q-Ponder achieves state-of-the-art (SOTA) performance on quality score regression benchmarks, delivering up to 6.5% higher SRCC on cross-domain datasets. Furthermore, Q-Ponder significantly outperforms description-based SOTA models, including its teacher model Qwen-2.5-VL-72B, particularly in description accuracy and reasonableness, demonstrating the generalization potential over diverse tasks.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 88 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
24 of 88 references.
Closest ancestors · 5
Same direction, newest first
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
Other references · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
7 more
- 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 83
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 43
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
- 2025MP-GUI: Modality Perception with MLLMs for GUI Understandingcited by 12
Built on by
Citing papers per year: 2025: 5; 2026: 9.
14 papers.
Sort:
By area:
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoningcited by 6
- 2025Refine-IQA: Multi-Stage Reinforcement Finetuning for Perceptual Image Quality Assessmentcited by 2
- 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessmentcited by 2
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessmentcited by 1
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probingcited by 1
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessmentcited by 1
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
- 2026Understanding Pure Textual Reasoning for Blind Image Quality Assessmentcited by 0
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoningcited by 0
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment29 Jun 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment14 Apr 2026
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning23 Mar 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment30 Jan 2026
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing21 Jan 2026
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning6 Jan 2026
- 2026Understanding Pure Textual Reasoning for Blind Image Quality Assessment5 Jan 2026
- 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessment18 Dec 2025
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessment1 Nov 2025
- 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessment12 Oct 2025
2 more
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2025Refine-IQA: Multi-Stage Reinforcement Finetuning for Perceptual Image Quality Assessmentcited by 2
- 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessmentcited by 2
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessmentcited by 1
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessmentcited by 0
- 2026MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment29 Jun 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment14 Apr 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment30 Jan 2026
- 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessment18 Dec 2025
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessment1 Nov 2025
- 2025Refine-IQA: Multi-Stage Reinforcement Finetuning for Perceptual Image Quality Assessment4 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
- 2026QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding
- 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement
- 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
- 2026Multi-Granularity Reasoning for Image Quality Assessment via Attribute-Aware Reinforcement Learning to Rank
- 2025Q-SiT: Teaching LMMs for Image Quality Scoring and Interpreting