mlsanityData to 14 Oct 2026

FineVQ: Fine-Grained User Generated Content Video Quality Assessment

arXiv 2412.19238 ↗First posted 26 Dec 2024cs.CV cs.LG cs.MMcited by 28

Not on the map. Why?

Abstract (arXiv)

The rapid growth of user-generated content (UGC) videos has produced an urgent need for effective video quality assessment (VQA) algorithms to monitor video quality and guide optimization and recommendation procedures. However, current VQA models generally only give an overall rating for a UGC video, which lacks fine-grained labels for serving video processing and recommendation applications. To address the challenges and promote the development of UGC videos, we establish the first large-scale Fine-grained Video quality assessment Database, termed FineVD, which comprises 6104 UGC videos with fine-grained quality scores and descriptions across multiple dimensions. Based on this database, we propose a Fine-grained Video Quality assessment (FineVQ) model to learn the fine-grained quality of UGC videos, with the capabilities of quality rating, quality scoring, and quality attribution. Extensive experimental results demonstrate that our proposed FineVQ can produce fine-grained video-quality results and achieve state-of-the-art performance on FineVD and other commonly used UGC-VQA datasets.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 51 of its 83 references that are in the map. First posted on arXiv 26 Dec 2024.

Builds on

51 of 83 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  12. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
38 more
  1. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  3. 2018SlowFast Networks for Video Recognitioncited by 1,867
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  5. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  6. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  7. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  8. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  9. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  10. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  11. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  12. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  13. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  14. 2019Quality Assessment of In-the-Wild Videoscited by 164
  15. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  16. 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
  17. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  18. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
  19. 2018Large-Scale Study of Perceptual Video Qualitycited by 127
  20. 2019YouTube UGC Dataset for Video Compression Researchcited by 124
  21. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
  22. 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
  23. 2020Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessmentcited by 50
  24. 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
  25. 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
  26. 2024Perceptual Video Quality Assessment: A Surveycited by 43
  27. 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
  28. 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
  29. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  30. 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
  31. 2023An Empirical Study of Scaling Instruct-Tuned Large Multimodal Modelscited by 32
  32. 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
  33. 2022Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessmentcited by 25
  34. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
  35. 2020Predicting the Quality of Compressed Videos with Pre-Existing Distortionscited by 21
  36. 2019UGC-VIDEO: perceptual quality assessment of user-generated videoscited by 19
  37. 2023Capturing Co-existing Distortions in User-Generated Content for No-reference Video Quality Assessmentcited by 18
  38. 2022Subjective and Objective Analysis of Streamed Gaming Videoscited by 14

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 14; 2026: 13.

28 papers.

Sort:

By area:

  1. 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
  2. 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
  3. 2026LPM 1.0: Video-based Character Performance Modelcited by 11
  4. 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretationcited by 10
  5. 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotationscited by 9
  6. 2025HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessmentcited by 7
  7. 2026Agentic Retoucher for Text-To-Image Generationcited by 7
  8. 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
  9. 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
  10. 2025DHQA-4D: Perceptual Quality Assessment of Dynamic 4D Digital Humancited by 3
  11. 2025Transform Trained Transformer for Accelerating Native 4K Video Generationcited by 3
  12. 2025Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animationcited by 3
16 more
  1. 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approachcited by 3
  2. 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videoscited by 2
  3. 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Modelcited by 2
  4. 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Imagescited by 2
  5. 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Videocited by 2
  6. 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
  7. 2025Semantic Frame Interpolationcited by 1
  8. 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videoscited by 1
  9. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1
  10. 2026Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generationcited by 0
  11. 2026Analytic Score Optimization for Multi Dimension Video Quality Assessmentcited by 0
  12. 2026Preference-Guided Debiasing for No-Reference Enhancement Image Quality Assessmentcited by 0
  13. 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thoughtcited by 0
  14. 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessmentcited by 0
  15. 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluationcited by 0
  16. 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessmentcited by 0