YouTube UGC Dataset for Video Compression Research
Not on the map. Why?
Abstract (arXiv)
Non-professional video, commonly known as User Generated Content (UGC) has become very popular in today's video sharing applications. However, traditional metrics used in compression and quality assessment, like BD-Rate and PSNR, are designed for pristine originals. Thus, their accuracy drops significantly when being applied on non-pristine originals (the majority of UGC). Understanding difficulties for compression and quality assessment in the scenario of UGC is important, but there are few public UGC datasets available for research. This paper introduces a large scale UGC dataset (1500 20 sec video clips) sampled from millions of YouTube videos. The dataset covers popular categories like Gaming, Sports, and new features like High Dynamic Range (HDR). Besides a novel sampling method based on features extracted from encoding, challenges for UGC compression and quality evaluation are also discussed. Shortcomings of traditional reference-based metrics on UGC are addressed. We demonstrate a promising way to evaluate UGC quality by no-reference objective quality metrics, and evaluate the current dataset with three no-reference metrics (Noise, Banding, and SLEEQ).
Key facts. Cited by 124 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 13; 2023: 28; 2024: 35; 2025: 24; 2026: 18.
124 papers.
Sort:
By area:
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
38 more
- 2022MuZero with Self-competition for Rate Control in VP9 Video Compressioncited by 27
- 2022Video compression dataset and benchmark of learning-based video-quality metricscited by 27
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2022Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessmentcited by 25
- 2023Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterioncited by 23
- 2024Modular Blind Video Quality Assessmentcited by 23
- 2021ChipQA: No-Reference Video Quality Prediction via Space-Time Chipscited by 22
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Modelscited by 22
- 2023Zoom-VQA: Patches, Frames and Clips Integration for Video Quality Assessmentcited by 21
- 2023Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessmentcited by 20
- 2022CONVIQT: Contrastive Video Quality Estimatorcited by 19
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
- 2023Capturing Co-existing Distortions in User-Generated Content for No-reference Video Quality Assessmentcited by 18
- 2024PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wildcited by 17
- 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
- 2021A strong baseline for image and video quality assessmentcited by 15
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
- 2022Subjective and Objective Analysis of Streamed Gaming Videoscited by 14
- 2023Perceptual Quality Assessment of Face Video Compression: A Benchmark and An Effective Methodcited by 14
- 2023Bitstream-Corrupted Video Recovery: A Novel Benchmark Dataset and Methodcited by 14
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2023Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancementcited by 12
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attackscited by 12
- 2024Spatial-Semantic Collaborative Cropping for User Generated Contentcited by 12
- 2023Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Modelscited by 11
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelingscited by 11
- 2024CLIPVQA:Video Quality Assessment via CLIPcited by 11
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perceptioncited by 11
- 2022FAVER: Blind Quality Prediction of Variable Frame Rate Videoscited by 10
- 2023GRACE: Loss-Resilient Real-Time Video through Neural Codecscited by 9
- 2024YouTube SFV+HDR Quality Datasetcited by 9
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learningcited by 9
- 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
- 2023HDR or SDR? A Subjective and Objective Study of Scaled and Compressed Videoscited by 7
- 2023HIDRO-VQA: High Dynamic Range Oracle for Video Quality Assessmentcited by 7
- 2023Knowledge Guided Semi-Supervised Learning for Quality Assessment of User Generated Videoscited by 7
50 most cited of 124 All 124 (JSON)
- 2026High-Fidelity Video Quality Assessment with VQA-Specific Saliency15 Sep 2026
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026LPM: Industrial-Scale Generative Video Restoration15 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2026A Self-Supervised Learning Framework for Video Encoding Complexity Clustering28 Jun 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Subjective Portrait Region Cropping in Landscape Videos with Temporal Annotation Smoothing27 Apr 2026
- 2026Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baseline27 Mar 2026
- 2026A Mamba-based Perceptual Loss Function for Learning-based UGC Transcoding26 Mar 2026
38 more
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcing26 Feb 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
- 2026Learning Perceptual Representations for Gaming NR-VQA with Multi-Task FR Signals12 Feb 2026
- 2026Exploring Real-Time Super-Resolution: Benchmarking and Fine-Tuning for Streaming Content11 Feb 2026
- 2026Morphe: High-Fidelity Generative Video Streaming with Vision Foundation Model3 Feb 2026
- 2025A Tri-Dynamic Preprocessing Framework for UGC Video Compression18 Dec 2025
- 2025VITAL: Vision-Encoder-centered Pre-training for LMMs in Visual Quality Assessment22 Nov 2025
- 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Video10 Nov 2025
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment7 Nov 2025
- 2025No-Reference Rendered Video Quality Assessment: Dataset and Metrics15 Oct 2025
- 2025Q-Router: Agentic Video Quality Assessment with Expert Model Routing and Artifact Localization9 Oct 2025
- 2025DIVA-VQA: Detecting Inter-frame Variations in UGC Video Quality14 Aug 2025
- 2025Subjective and Objective Quality Assessment of Banding Artifacts on Compressed Videos12 Aug 2025
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning8 Aug 2025
- 2025Prompting for Performance: Exploring LLMs for Configuring Software13 Jul 2025
- 2025LEHA-CVQAD: Dataset To Enable Generalized Video Quality Assessment of Compression Artifacts5 Jul 2025
- 2025RGC-VQA: An Exploration Database for Robotic-Generated Video Quality Assessment30 Jun 2025
- 2025Scaling-up Perceptual Video Quality Assessment28 May 2025
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessment21 May 2025
- 2025Generalizable Video Quality Assessment via Weak-to-Strong Learning6 May 2025
- 2025DiffVQA: Video Quality Assessment Using Diffusion Feature Extractor6 May 2025
- 2025Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding25 Apr 2025
- 2025MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessment22 Apr 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception13 Mar 2025
- 2025Exploring Simple Siamese Network for High-Resolution Video Quality Assessment4 Mar 2025
- 2025Multi-Branch Collaborative Learning Network for Video Quality Assessment in Industrial Video Search9 Feb 2025
- 2025T2VEval: Benchmark Dataset and Objective Evaluation Method for T2V-generated Videos15 Jan 2025
- 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videos29 Dec 2024
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessment26 Dec 2024
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024Video Quality Assessment: A Comprehensive Survey4 Dec 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024Secure Video Quality Assessment Resisting Adversarial Attacks9 Oct 2024
- 2024AIM 2024 Challenge on Video Super-Resolution Quality Assessment: Methods and Results5 Oct 2024
- 2024Subjective and Objective Quality-of-Experience Evaluation Study for Live Video Streaming26 Sep 2024
50 newest of 124 All 124 (JSON)
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2025Scaling-up Perceptual Video Quality Assessmentcited by 5
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLMcited by 4
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptationcited by 3
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessmentcited by 1
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessmentcited by 1
- 2025VITAL: Vision-Encoder-centered Pre-training for LMMs in Visual Quality Assessmentcited by 1
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Modelscited by 0
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2025VITAL: Vision-Encoder-centered Pre-training for LMMs in Visual Quality Assessment22 Nov 2025
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025Scaling-up Perceptual Video Quality Assessment28 May 2025
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessment21 May 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalizationcited by 3
- 2025DiffVQA: Video Quality Assessment Using Diffusion Feature Extractorcited by 1
- 2025Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understandingcited by 0
- 2026LPM: Industrial-Scale Generative Video Restorationcited by 0
- 2026LPM: Industrial-Scale Generative Video Restoration15 Jul 2026
- 2025DiffVQA: Video Quality Assessment Using Diffusion Feature Extractor6 May 2025
- 2025Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding25 Apr 2025
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalization7 Jun 2024
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
- 2022MuZero with Self-competition for Rate Control in VP9 Video Compressioncited by 27
12 most cited of 107 All 107 (JSON)
- 2026High-Fidelity Video Quality Assessment with VQA-Specific Saliency15 Sep 2026
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026A Self-Supervised Learning Framework for Video Encoding Complexity Clustering28 Jun 2026
- 2026Community-Aware Assessment of Social Textual Engagement and Resonance: A Human-Centric Perspective on User-Generated Content Evaluation1 Jun 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Subjective Portrait Region Cropping in Landscape Videos with Temporal Annotation Smoothing27 Apr 2026
- 2026Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baseline27 Mar 2026
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026Scaling Audio-Visual Quality Assessment Dataset via Crowdsourcing26 Feb 2026
- 2026Analytic Score Optimization for Multi Dimension Video Quality Assessment18 Feb 2026
12 newest of 107 All 107 (JSON)