mlsanityData to 7 Oct 2026

Q-Insight: Understanding Image Quality via Visual Reinforcement Learning

arXiv 2503.22679 ↗First posted 28 Mar 2025cs.CVcited by 93

Not on the map. Why?

Cited by 28 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generation. The rapid advancement of multi-modal large language models (MLLMs) has significantly broadened the scope of IQA, moving toward comprehensive image quality understanding that incorporates content analysis, degradation perception, and comparison reasoning beyond mere numerical scoring. Previous MLLM-based methods typically either generate numerical scores lacking interpretability or heavily rely on supervised fine-tuning (SFT) using large-scale annotated datasets to provide descriptive assessments, limiting their flexibility and applicability. In this paper, we propose Q-Insight, a reinforcement learning-based model built upon group relative policy optimization (GRPO), which demonstrates strong visual reasoning capability for image quality understanding while requiring only a limited amount of rating scores and degradation labels. By jointly optimizing score regression and degradation perception tasks with carefully designed reward functions, our approach effectively exploits their mutual benefits for enhanced performance. Extensive experiments demonstrate that Q-Insight substantially outperforms existing state-of-the-art methods in both score regression and degradation perception tasks, while exhibiting impressive zero-shot generalization to comparison reasoning tasks. Code will be available at https://github.com/lwq20020127/Q-Insight.

Key facts. Cited by 93 papers in the map (data through 7 Oct 2026). Builds on 56 of its 76 references that are in the map. First posted on arXiv 28 Mar 2025.

Builds on

56 of 76 references.

References · 56

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  10. 2025Qwen2.5-VL Technical Reportcited by 5,418
  11. 2017Deep reinforcement learning from human preferencescited by 3,846
  12. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
38 more
  1. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  2. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  3. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
  4. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  5. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  6. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  7. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  8. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  9. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  10. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
  11. 2017NIMA: Neural Image Assessmentcited by 387
  12. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  13. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  14. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  15. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  16. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
  17. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
  18. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
  19. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
  20. 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 158
  21. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  22. 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
  23. 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
  24. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
  25. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  26. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  27. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 117
  28. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  29. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  30. 2024o1-Coder: an o1 Replication for Codingcited by 77
  31. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
  32. 2022Shift-tolerant Perceptual Similarity Metriccited by 44
  33. 2021GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessmentcited by 43
  34. 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
  35. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  36. 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
  37. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  38. 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 41; 2026: 52.

93 papers.

Sort:

By area:

  1. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
  2. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 86
  3. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
  4. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  5. 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Modelscited by 43
  6. 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 37
  7. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
  8. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
  9. 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 19
  10. 2025Sailing by the Stars: A Survey on Reward Models and Learning Strategies for Learning from Rewardscited by 14
  11. 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessmentcited by 14
  12. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
38 more
  1. 2025Presenting a Paper is an Art: Self-Improvement Aesthetic Agents for Academic Presentationscited by 11
  2. 2025VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoningcited by 11
  3. 2025AesBiasBench: Evaluating Bias and Alignment in Multimodal Language Models for Personalized Image Aesthetic Assessmentcited by 10
  4. 2025Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Rankingcited by 10
  5. 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learningcited by 9
  6. 2025RadarQA: Multi-modal Quality Analysis of Weather Radar Forecastscited by 8
  7. 2025PhotoFramer: Multi-modal Image Composition Instructioncited by 8
  8. 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Modelscited by 7
  9. 2025LoCoT2V-Bench: Benchmarking Long-Form and Complex Text-to-Video Generationcited by 6
  10. 2025Unlocking the Essence of Beauty: Advanced Aesthetic Reasoning with Relative-Absolute Policy Optimizationcited by 5
  11. 2025EmoFeedback2: Reinforcement of Continuous Emotional Image Generation via LVLM-based Reward and Textual Feedbackcited by 5
  12. 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
  13. 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
  14. 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 3
  15. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
  16. 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessmentcited by 3
  17. 2025Refine-IQA: Multi-Stage Reinforcement Finetuning for Perceptual Image Quality Assessmentcited by 2
  18. 2025Creative4U: MLLMs-based Advertising Creative Image Selector with Comparative Reasoningcited by 2
  19. 2025AgenticIQA: An Agentic Framework for Adaptive and Interpretable Image Quality Assessmentcited by 2
  20. 2025Beyond the Ground Truth: Enhanced Supervision for Image Restorationcited by 2
  21. 2025Decouple to Generalize: Context-First Self-Evolving Learning for Data-Scarce Vision-Language Reasoningcited by 2
  22. 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessmentcited by 2
  23. 2025Plug In, Grade Right: Psychology-Inspired AGIQAcited by 2
  24. 2025REVEALER: Reinforcement-Guided Visual Reasoning for Element-Level Text-Image Alignment Evaluationcited by 2
  25. 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Modelcited by 2
  26. 2026Ground What You See: Hallucination-Resistant MLLMs via Caption Feedback, Diversity-Aware Sampling, and Conflict Regularizationcited by 2
  27. 2026QualiRAG: Retrieval-Augmented Generation for Visual Quality Understandingcited by 2
  28. 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
  29. 2026E-comIQ-ZH: A Human-Aligned Dataset and Benchmark for Fine-Grained Evaluation of E-commerce Posters with Chain-of-Thoughtcited by 2
  30. 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practicescited by 2
  31. 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessmentcited by 2
  32. 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modelingcited by 2
  33. 2025OmniQuality-R: Advancing Reward Models Through All-Encompassing Quality Assessmentcited by 1
  34. 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probingcited by 1
  35. 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessmentcited by 1
  36. 2026MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidancecited by 1
  37. 2026ArtifactLens: Hundreds of Labels Are Enough for Artifact Detection with VLMscited by 1
  38. 2026Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centeredcited by 1

50 most cited of 93 All 93 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
  2. 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning
  3. 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models
  4. 2025FinPercep-RM: A Fine-grained Reward Model and Co-evolutionary Curriculum for RL-based Real-world Super-Resolution
  5. 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
  6. 2025Q-Adapt: Adapting LMM for Visual Quality Assessment with Progressive Instruction Tuning
  7. 2026Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency
  8. 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework