Better Supervised Fine-tuning for VQA: Integer-Only Loss
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
With the rapid advancement of vision language models(VLM), their ability to assess visual content based on specific criteria and dimensions has become increasingly critical for applications such as video-theme consistency assessment and visual quality scoring. However, existing methods often suffer from imprecise results and inefficient loss calculation, which limit the focus of the model on key evaluation indicators. To address this, we propose IOVQA(Integer-only VQA), a novel fine-tuning approach tailored for VLMs to enhance their performance in video quality assessment tasks. The key innovation of IOVQA lies in its label construction and its targeted loss calculation mechanism. Specifically, during dataset curation, we constrain the model's output to integers within the range of [10,50], ensuring numerical stability, and convert decimal Overall_MOS to integer before using them as labels. We also introduce a target-mask strategy: when computing the loss, only the first two-digit-integer of the label is unmasked, forcing the model to learn the critical components of the numerical evaluation. After fine-tuning the Qwen2.5-VL model using the constructed dataset, experimental results demonstrate that the proposed method significantly improves the model's accuracy and consistency in the VQA task, ranking 3rd in VQualA 2025 GenAI-Bench AIGC Video Quality Assessment Challenge -- Track I. Our work highlights the effectiveness of merely leaving integer labels during fine-tuning, providing an effective idea for optimizing VLMs in quantitative evaluation scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 34 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
26 of 34 references.
Closest ancestors · 1
Same direction, newest first
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2016Improved Techniques for Training GANscited by 2,970
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
13 more
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Photorealistic Video Generation with Diffusion Modelscited by 306
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessmentcited by 39
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
- 2024VQA2: Visual Question Answering for Video Quality Assessment
- 2025MVQA-68K: A Multi-dimensional and Causally-annotated Dataset with Quality Interpretability for Video Assessment
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models
- 2025Scaling-up Perceptual Video Quality Assessment
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Dataset
- 2025Towards Unified Video Quality Assessment