Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment
Not on the map. Why?
Abstract (arXiv)
Image Quality Assessment (IQA) predicts perceptual quality scores consistent with human judgments. Recent RL-based IQA methods built on MLLMs focus on generating visual quality descriptions and scores, ignoring two key reliability limitations: (i) although the model's prediction stability varies significantly across training samples, existing GRPO-based methods apply uniform advantage weighting, thereby amplifying noisy signals from unstable samples in gradient updates; (ii) most works emphasize text-grounded reasoning over images while overlooking the model's visual perception ability of image content. In this paper, we propose Q-Hawkeye, an RL-based reliable visual policy optimization framework that redesigns the learning signal through unified Uncertainty-Aware Dynamic Optimization and Perception-Aware Optimization. Q-Hawkeye estimates predictive uncertainty using the variance of predicted scores across multiple rollouts and leverages this uncertainty to reweight each sample's update strength, stabilizing policy optimization. To strengthen perceptual reliability, we construct paired inputs of degraded images and their original images and introduce an Implicit Perception Loss that constrains the model to ground its quality judgments in genuine visual evidence. Extensive experiments demonstrate that Q-Hawkeye outperforms state-of-the-art methods and generalizes better across multiple datasets. Our dataset and code are available at https://github.com/AMAP-ML/Q-Hawkeye.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
45 of 61 references.
References · 45
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2017NIMA: Neural Image Assessmentcited by 387
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
33 more
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2025Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning Incentivizationcited by 124
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 116
- 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 95
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learningcited by 86
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2019dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairscited by 73
- 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoningcited by 46
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
- 2025Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understandingcited by 28
- 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
- 2025HS-STaR: Hierarchical Sampling for Self-Taught Reasoners via Difficulty Estimation and Budget Reallocationcited by 18
- 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessmentcited by 14
- 2025SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Modelscited by 14
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessmentcited by 12
- 2025Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Modelcited by 11
- 2025LD-RPS: Zero-Shot Unified Image Restoration via Latent Diffusion Recurrent Posterior Samplingcited by 9
- 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedycited by 7
- 2026Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimizationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
- 2026From Glance to Scrutiny: Progressive Distortion Reasoning for Fine-Grained Image Quality Assessment
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning
- 2026Multi-Granularity Reasoning for Image Quality Assessment via Attribute-Aware Reinforcement Learning to Rank
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning
- 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement