FineVQ: Fine-Grained User Generated Content Video Quality Assessment
Not on the map. Why?
Abstract (arXiv)
The rapid growth of user-generated content (UGC) videos has produced an urgent need for effective video quality assessment (VQA) algorithms to monitor video quality and guide optimization and recommendation procedures. However, current VQA models generally only give an overall rating for a UGC video, which lacks fine-grained labels for serving video processing and recommendation applications. To address the challenges and promote the development of UGC videos, we establish the first large-scale Fine-grained Video quality assessment Database, termed FineVD, which comprises 6104 UGC videos with fine-grained quality scores and descriptions across multiple dimensions. Based on this database, we propose a Fine-grained Video Quality assessment (FineVQ) model to learn the fine-grained quality of UGC videos, with the capabilities of quality rating, quality scoring, and quality attribution. Extensive experimental results demonstrate that our proposed FineVQ can produce fine-grained video-quality results and achieve state-of-the-art performance on FineVD and other commonly used UGC-VQA datasets.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 51 of its 83 references that are in the map. First posted on arXiv 26 Dec 2024.
Builds on
51 of 83 references.
References · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
38 more
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2020Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessmentcited by 50
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2024Perceptual Video Quality Assessment: A Surveycited by 43
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
- 2023An Empirical Study of Scaling Instruct-Tuned Large Multimodal Modelscited by 32
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2022Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessmentcited by 25
- 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
- 2020Predicting the Quality of Compressed Videos with Pre-Existing Distortionscited by 21
- 2019UGC-VIDEO: perceptual quality assessment of user-generated videoscited by 19
- 2023Capturing Co-existing Distortions in User-Generated Content for No-reference Video Quality Assessmentcited by 18
- 2022Subjective and Objective Analysis of Streamed Gaming Videoscited by 14
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 14; 2026: 13.
28 papers.
Sort:
By area:
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretationcited by 10
- 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotationscited by 9
- 2025HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessmentcited by 7
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
- 2025DHQA-4D: Perceptual Quality Assessment of Dynamic 4D Digital Humancited by 3
- 2025Transform Trained Transformer for Accelerating Native 4K Video Generationcited by 3
- 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animationcited by 3
16 more
- 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approachcited by 3
- 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videoscited by 2
- 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Modelcited by 2
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Imagescited by 2
- 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Videocited by 2
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2025Semantic Frame Interpolationcited by 1
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videoscited by 1
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generationcited by 0
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessmentcited by 0
- 2026Preference-Guided Debiasing for No-Reference Enhancement Image Quality Assessmentcited by 0
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thoughtcited by 0
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessmentcited by 0
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluationcited by 0
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessmentcited by 0
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement8 May 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought24 Mar 2026
- 2026Preference-Guided Debiasing for No-Reference Enhancement Image Quality Assessment20 Mar 2026
- 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach20 Mar 2026
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videos1 Mar 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generation13 Jan 2026
16 more
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animation15 Dec 2025
- 2025Transform Trained Transformer for Accelerating Native 4K Video Generation15 Dec 2025
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation18 Nov 2025
- 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Video10 Nov 2025
- 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotations29 Oct 2025
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?13 Oct 2025
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration9 Oct 2025
- 2025DHQA-4D: Perceptual Quality Assessment of Dynamic 4D Digital Human4 Oct 2025
- 2025Semantic Frame Interpolation7 Jul 2025
- 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Images27 Jun 2025
- 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model5 Jun 2025
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Results3 Jun 2025
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation17 May 2025
- 2025HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment2 Jan 2025
- 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videos29 Dec 2024
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotationscited by 9
- 2025HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessmentcited by 7
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
- 2025DHQA-4D: Perceptual Quality Assessment of Dynamic 4D Digital Humancited by 3
- 2025Transform Trained Transformer for Accelerating Native 4K Video Generationcited by 3
- 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animationcited by 3
- 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approachcited by 3
- 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videoscited by 2
12 most cited of 23 All 23 (JSON)
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026Preference-Guided Debiasing for No-Reference Enhancement Image Quality Assessment20 Mar 2026
- 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach20 Mar 2026
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videos1 Mar 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animation15 Dec 2025
- 2025Transform Trained Transformer for Accelerating Native 4K Video Generation15 Dec 2025
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation18 Nov 2025
12 newest of 23 All 23 (JSON)