MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos
Not on the map. Why?
Abstract (arXiv)
User-generated content (UGC) live videos are often bothered by various distortions during capture procedures and thus exhibit diverse visual qualities. Such source videos are further compressed and transcoded by media server providers before being distributed to end-users. Because of the flourishing of UGC live videos, effective video quality assessment (VQA) tools are needed to monitor and perceptually optimize live streaming videos in the distributing process. In this paper, we address UGC Live VQA problems by constructing a first-of-a-kind subjective UGC Live VQA database and developing an effective evaluation tool. Concretely, 418 source UGC videos are collected in real live streaming scenarios and 3,762 compressed ones at different bit rates are generated for the subsequent subjective VQA experiments. Based on the built database, we develop a underlineMulti-underlineDimensional underlineVQA (MD-VQA) evaluator to measure the visual quality of UGC live videos from semantic, distortion, and motion aspects respectively. Extensive experimental results show that MD-VQA achieves state-of-the-art performance on both our UGC Live VQA database and existing compressed UGC VQA databases.
Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 27 Mar 2023.
Builds on
25 of 59 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2021Video Swin Transformercited by 1,091
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 332
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
13 more
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2016Understanding How Image Quality Affects Deep Neural Networkscited by 119
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2017VideoSet: A Large-Scale Compressed Video Quality Dataset Based on JND Measurementcited by 33
- 2020ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Predictioncited by 33
- 2022Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessmentcited by 25
- 2021ChipQA: No-Reference Video Quality Prediction via Space-Time Chipscited by 22
- 2020Predicting the Quality of Compressed Videos with Pre-Existing Distortionscited by 21
- 2019UGC-VIDEO: perceptual quality assessment of user-generated videoscited by 19
- 2022A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Mapscited by 8
- 2022Perceptual Quality Assessment for Fine-Grained Compressed Imagescited by 5
- 2022Subjective Quality Assessment for Images Generated by Computer Graphicscited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 16; 2025: 16; 2026: 9.
46 papers.
Sort:
By area:
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Modelscited by 22
- 2023GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessmentcited by 21
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
34 more
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelingscited by 11
- 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restorationcited by 10
- 2024Dual-Branch Network for Portrait Image Quality Assessmentcited by 8
- 2025VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Resultscited by 6
- 2024Delving Deep into Engagement Prediction of Short Videoscited by 4
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLMcited by 4
- 2025InternVQA: Advancing Compressed Video Quality Assessment with Distilling Large Foundation Modelcited by 4
- 2025Engagement Prediction of Short Videos with Large Multimodal Modelscited by 4
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalizationcited by 3
- 2025Efficient Face Image Quality Assessment via Self-training and Knowledge Distillationcited by 3
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptationcited by 3
- 2024BVI-UGC: A Video Quality Database for User-Generated Content Transcodingcited by 2
- 2025Multi-Branch Collaborative Learning Network for Video Quality Assessment in Industrial Video Searchcited by 2
- 2025MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessmentcited by 2
- 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Imagescited by 2
- 2025MVQA-68K: A Multi-dimensional and Causally-annotated Dataset with Quality Interpretability for Video Assessmentcited by 2
- 2024Secure Video Quality Assessment Resisting Adversarial Attackscited by 1
- 2024Diverse Sign Language Translationcited by 1
- 2025A Multi-annotated and Multi-modal Dataset for Wide-angle Video Quality Assessmentcited by 1
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessmentcited by 1
- 2025LEHA-CVQAD: Dataset To Enable Generalized Video Quality Assessment of Compression Artifactscited by 1
- 2026VideoAesBench: Benchmarking the Video Aesthetics Perception Capabilities of Large Multimodal Modelscited by 1
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videoscited by 1
- 2026SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blendingcited by 1
- 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoringcited by 0
- 2025No-Reference Rendered Video Quality Assessment: Dataset and Metricscited by 0
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessmentcited by 0
- 2026Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baselinecited by 0
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessmentcited by 0
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluationcited by 0
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributionscited by 0
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Mediacited by 0
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending27 Jun 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baseline27 Mar 2026
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videos1 Mar 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
- 2026VideoAesBench: Benchmarking the Video Aesthetics Perception Capabilities of Large Multimodal Models29 Jan 2026
- 2025No-Reference Rendered Video Quality Assessment: Dataset and Metrics15 Oct 2025
- 2025MVQA-68K: A Multi-dimensional and Causally-annotated Dataset with Quality Interpretability for Video Assessment15 Sep 2025
- 2025VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Results3 Sep 2025
34 more
- 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restoration20 Aug 2025
- 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Images18 Aug 2025
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025Engagement Prediction of Short Videos with Large Multimodal Models4 Aug 2025
- 2025Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation21 Jul 2025
- 2025LEHA-CVQAD: Dataset To Enable Generalized Video Quality Assessment of Compression Artifacts5 Jul 2025
- 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoring26 Jun 2025
- 2025MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessment22 Apr 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessment12 Apr 2025
- 2025InternVQA: Advancing Compressed Video Quality Assessment with Distilling Large Foundation Model26 Feb 2025
- 2025Multi-Branch Collaborative Learning Network for Video Quality Assessment in Industrial Video Search9 Feb 2025
- 2025A Multi-annotated and Multi-modal Dataset for Wide-angle Video Quality Assessment21 Jan 2025
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessment26 Dec 2024
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024Video Quality Assessment: A Comprehensive Survey4 Dec 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024Diverse Sign Language Translation25 Oct 2024
- 2024Secure Video Quality Assessment Resisting Adversarial Attacks9 Oct 2024
- 2024Delving Deep into Engagement Prediction of Short Videos30 Sep 2024
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2024Quality Assessment in the Era of Large Models: A Survey17 Aug 2024
- 2024BVI-UGC: A Video Quality Database for User-Generated Content Transcoding13 Aug 2024
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalization7 Jun 2024
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Features14 May 2024
- 2024Dual-Branch Network for Portrait Image Quality Assessment14 May 2024
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videos11 Feb 2024
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessment5 Jan 2024
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models23 Dec 2023
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelings13 Nov 2023
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability9 Aug 2023
- 2023GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessment9 Jun 2023
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approach22 May 2023
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLMcited by 4
- 2025Engagement Prediction of Short Videos with Large Multimodal Modelscited by 4
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptationcited by 3
- 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Imagescited by 2
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessmentcited by 1
- 2026VideoAesBench: Benchmarking the Video Aesthetics Perception Capabilities of Large Multimodal Modelscited by 1
- 2026VideoAesBench: Benchmarking the Video Aesthetics Perception Capabilities of Large Multimodal Models29 Jan 2026
- 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Images18 Aug 2025
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025Engagement Prediction of Short Videos with Large Multimodal Models4 Aug 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restorationcited by 10
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalizationcited by 3
- 2026SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blendingcited by 1
- 2026SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending27 Jun 2026
- 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restoration20 Aug 2025
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalization7 Jun 2024
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Modelscited by 22
- 2023GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessmentcited by 21
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelingscited by 11
12 most cited of 32 All 32 (JSON)
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baseline27 Mar 2026
- 2026Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videos1 Mar 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
- 2025No-Reference Rendered Video Quality Assessment: Dataset and Metrics15 Oct 2025
- 2025MVQA-68K: A Multi-dimensional and Causally-annotated Dataset with Quality Interpretability for Video Assessment15 Sep 2025
- 2025VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Results3 Sep 2025
- 2025LEHA-CVQAD: Dataset To Enable Generalized Video Quality Assessment of Compression Artifacts5 Jul 2025
- 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoring26 Jun 2025
12 newest of 32 All 32 (JSON)