Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception
Not on the map. Why?
Abstract (arXiv)
Perceptual quality assessment of the videos acquired in the wilds is of vital importance for quality assurance of video services. The inaccessibility of reference videos with pristine quality and the complexity of authentic distortions pose great challenges for this kind of blind video quality assessment (BVQA) task. Although model-based transfer learning is an effective and efficient paradigm for the BVQA task, it remains to be a challenge to explore what and how to bridge the domain shifts for better video representation. In this work, we propose to transfer knowledge from image quality assessment (IQA) databases with authentic distortions and large-scale action recognition with rich motion patterns. We rely on both groups of data to learn the feature extractor. We train the proposed model on the target VQA databases using a mixed list-wise ranking loss function. Extensive experiments on six databases demonstrate that our method performs very competitively under both individual database and mixed database training settings. We also verify the rationality of each component of the proposed method and explore a simple manner for further improvement.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). Builds on 31 of its 87 references that are in the map. First posted on arXiv 19 Aug 2021.
Builds on
31 of 87 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2021Domain Generalization: A Surveycited by 760
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
19 more
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2020Fast Differentiable Sorting and Rankingcited by 196
- 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2020MotionSqueeze: Neural Motion Feature Learning for Video Understandingcited by 72
- 2020Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Trainingcited by 72
- 2016Perceptual Quality Prediction on Authentically Distorted Images Using a Bag of Features Approachcited by 71
- 2021Continual Learning for Blind Image Quality Assessmentcited by 36
- 2020A Comparative Evaluation of Temporal Pooling Methods for Blind Video Quality Assessmentcited by 22
- 2021Quantifying Visual Image Quality: A Bayesian Viewcited by 20
- 2021Task-Specific Normalization for Continual Learning of Blind Image Quality Modelscited by 18
- 2020Perceptual Video Quality Prediction Emphasizing Chroma Distortionscited by 10
- 2021Regression or Classification? New Methods to Evaluate No-Reference Picture and Video Quality Modelscited by 4
Built on by
Citing papers per year: 2022: 12; 2023: 17; 2024: 35; 2025: 21; 2026: 12.
97 papers.
Sort:
By area:
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2024Towards A Better Metric for Text-to-Video Generationcited by 50
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
38 more
- 2024GAIA: Rethinking Action Quality Assessment for AI-Generated Videoscited by 30
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMMcited by 24
- 2023Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterioncited by 23
- 2024Modular Blind Video Quality Assessmentcited by 23
- 2022Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Modelcited by 22
- 2023Exploring the Naturalness of AI-Generated Imagescited by 22
- 2023Zoom-VQA: Patches, Frames and Clips Integration for Video Quality Assessmentcited by 21
- 2023Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessmentcited by 20
- 2022CONVIQT: Contrastive Video Quality Estimatorcited by 19
- 2024Enhancing Blind Video Quality Assessment with Rich Quality-aware Featurescited by 19
- 2023Capturing Co-existing Distortions in User-Generated Content for No-reference Video Quality Assessmentcited by 18
- 2024PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wildcited by 17
- 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
- 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2024Exploring AIGC Video Quality: A Focus on Visual Harmony, Video-Text Consistency and Domain Distribution Gapcited by 13
- 2023Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancementcited by 12
- 2023Vulnerabilities in Video Quality Assessment Models: The Challenge of Adversarial Attackscited by 12
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelingscited by 11
- 2024CLIPVQA:Video Quality Assessment via CLIPcited by 11
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perceptioncited by 11
- 2022FAVER: Blind Quality Prediction of Variable Frame Rate Videoscited by 10
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretationcited by 10
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metriccited by 9
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learningcited by 9
- 2024THQA: A Perceptual Quality Assessment Database for Talking Headscited by 8
- 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
- 2023Knowledge Guided Semi-Supervised Learning for Quality Assessment of User Generated Videoscited by 7
- 2022REQA: Coarse-to-fine Assessment of Image Quality to Alleviate the Range Effectcited by 6
- 2024SHE-Net: Syntax-Hierarchy-Enhanced Text-Video Retrievalcited by 6
- 2024Light-VQA+: A Video Quality Assessment Model for Exposure Correction with Vision-Language Guidancecited by 6
- 2025T2VEval: Benchmark Dataset and Objective Evaluation Method for T2V-generated Videoscited by 6
- 2022Boosting Point-BERT by Multi-choice Tokenscited by 5
- 2022HVS Revisited: A Comprehensive Video Quality Assessment Frameworkcited by 5
50 most cited of 97 All 97 (JSON)
- 2026High-Fidelity Video Quality Assessment with VQA-Specific Saliency15 Sep 2026
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model18 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment18 Apr 2026
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment14 Apr 2026
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026EduVQA: Towards Concept-Aware Assessment of Educational AI-Generated Videos3 Mar 2026
- 2026Convolutions Need Registers Too: HVS-Inspired Dynamic Attention for Video Quality Assessment16 Jan 2026
38 more
- 2025Towards Unified Video Quality Assessment1 Dec 2025
- 2025EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humans1 Dec 2025
- 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Video10 Nov 2025
- 2025DIVA-VQA: Detecting Inter-frame Variations in UGC Video Quality14 Aug 2025
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning8 Aug 2025
- 2025Engagement Prediction of Short Videos with Large Multimodal Models4 Aug 2025
- 2025Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Heads31 Jul 2025
- 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model5 Jun 2025
- 2025Scaling-up Perceptual Video Quality Assessment28 May 2025
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessment21 May 2025
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation17 May 2025
- 2025Generalizable Video Quality Assessment via Weak-to-Strong Learning6 May 2025
- 2025DiffVQA: Video Quality Assessment Using Diffusion Feature Extractor6 May 2025
- 2025MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessment22 Apr 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception13 Mar 2025
- 2025Exploring Simple Siamese Network for High-Resolution Video Quality Assessment4 Mar 2025
- 2025T2VEval: Benchmark Dataset and Objective Evaluation Method for T2V-generated Videos15 Jan 2025
- 2025Video Quality Assessment for Online Processing: From Spatial to Temporal Sampling13 Jan 2025
- 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment6 Jan 2025
- 2024ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videos29 Dec 2024
- 2024Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment25 Dec 2024
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024Video Quality Assessment: A Comprehensive Survey4 Dec 2024
- 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM26 Nov 2024
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metric25 Nov 2024
- 2024A review on Machine Learning based User-Centric Multimedia Streaming Techniques24 Nov 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024Secure Video Quality Assessment Resisting Adversarial Attacks9 Oct 2024
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep 2024
- 2024Revisiting Video Quality Assessment from the Perspective of Generalization23 Sep 2024
- 2024Convolutional Neural Network Compression Based on Low-Rank Decomposition29 Aug 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2024QPT V2: Masked Image Modeling Advances Visual Scoring23 Jul 2024
- 2024ReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality Assessment16 Jul 2024
- 2024CLIPVQA:Video Quality Assessment via CLIP6 Jul 2024
- 2024GAIA: Rethinking Action Quality Assessment for AI-Generated Videos10 Jun 2024
50 newest of 97 All 97 (JSON)
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMMcited by 24
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretationcited by 10
- 2025Scaling-up Perceptual Video Quality Assessmentcited by 5
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLMcited by 4
- 2025Engagement Prediction of Short Videos with Large Multimodal Modelscited by 4
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptationcited by 3
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessmentcited by 1
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessmentcited by 1
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessmentcited by 1
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment14 Apr 2026
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation8 Aug 2025
- 2025Engagement Prediction of Short Videos with Large Multimodal Models4 Aug 2025
- 2025Scaling-up Perceptual Video Quality Assessment28 May 2025
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessment21 May 2025
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation17 May 2025
- 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment16 Apr 2025
- 2024An Ensemble Approach to Short-form Video Quality Assessment Using Multimodal LLM24 Dec 2024
- 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM26 Nov 2024
- 2024VQA2: Visual Question Answering for Video Quality Assessment6 Nov 2024
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep 2024
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models26 Aug 2024
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2024Towards A Better Metric for Text-to-Video Generationcited by 50
- 2023MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videoscited by 46
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024GAIA: Rethinking Action Quality Assessment for AI-Generated Videoscited by 30
12 most cited of 78 All 78 (JSON)
- 2026High-Fidelity Video Quality Assessment with VQA-Specific Saliency15 Sep 2026
- 2026LLaVA-Assessor: Building the Foundation LMM For Visual Quality Assessment11 Aug 2026
- 2026TREND-10K: A Comprehensive Dataset for Next-Generation Video Quality Assessment Based on Preference-Driven Media11 Aug 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions6 Jul 2026
- 2026FGSVQA: Frequency-Guided Short-form Video Quality Assessment19 May 2026
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment18 Apr 2026
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026Convolutions Need Registers Too: HVS-Inspired Dynamic Attention for Video Quality Assessment16 Jan 2026
- 2025EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humans1 Dec 2025
- 2025CAMP-VQA: Caption-Embedded Multimodal Perception for No-Reference Quality Assessment of Compressed Video10 Nov 2025
- 2025DIVA-VQA: Detecting Inter-frame Variations in UGC Video Quality14 Aug 2025
12 newest of 78 All 78 (JSON)