mlsanityData to 14 Oct 2026

Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment

arXiv 2506.05384 ↗First posted 3 Jun 2025cs.CV cs.AI cs.MMcited by 14

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as separate tasks with disjoint optimization objectives, leading to a trade-off: models adept at quality reasoning descriptions struggle with precise score regression, while score-focused models lack interpretability. This limitation hinders the full potential of MLLMs in visual quality assessment, where accuracy and interpretability should be mutually reinforcing. To address this, we propose a unified two-stage training framework comprising a cold-start stage and a reinforcement learning-based fine-tuning stage. Specifically, in the first stage, we distill high-quality data from a teacher model through expert-designed prompts, initializing reasoning capabilities via cross-entropy loss supervision. In the second stage, we introduce a novel reward with Group Relative Policy Optimization (GRPO) to jointly optimize scoring accuracy and reasoning consistency. We designate the models derived from these two stages as Q-Ponder-CI and Q-Ponder. Extensive experiments show that Q-Ponder achieves state-of-the-art (SOTA) performance on quality score regression benchmarks, delivering up to 6.5% higher SRCC on cross-domain datasets. Furthermore, Q-Ponder significantly outperforms description-based SOTA models, including its teacher model Qwen-2.5-VL-72B, particularly in description accuracy and reasonableness, demonstrating the generalization potential over diverse tasks.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 88 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

24 of 88 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
  2. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  3. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  4. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  5. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan

Other references · 19

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  6. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  7. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  8. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
  9. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  10. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
  11. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
  12. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
7 more
  1. 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 83
  2. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
  3. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 43
  4. 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
  5. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  6. 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
  7. 2025MP-GUI: Modality Perception with MLLMs for GUI Understandingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 9.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
  2. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank
  3. 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
  4. 2026QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding
  5. 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement
  6. 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
  7. 2026Multi-Granularity Reasoning for Image Quality Assessment via Attribute-Aware Reinforcement Learning to Rank
  8. 2025Q-SiT: Teaching LMMs for Image Quality Scoring and Interpreting