# Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessment

arXiv: https://arxiv.org/abs/2012.13936 · HTML: https://mlsanity.com/paper/2012.13936/

## Key facts

- Cited by 50 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Dec 2020.

## Built on by (most cited first, 30 of 50)

- [Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives](https://mlsanity.com/paper/2211.04894/) (2022)
- [FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Sampling](https://mlsanity.com/paper/2207.02595/) (2022)
- [Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessment](https://mlsanity.com/paper/2210.05357/) (2022)
- [Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approach](https://mlsanity.com/paper/2305.12726/) (2023)
- [DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment](https://mlsanity.com/paper/2206.09853/) (2022)
- [KVQ: Kwai Video Quality Assessment for Short-form Videos](https://mlsanity.com/paper/2402.07220/) (2024)
- [NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results](https://mlsanity.com/paper/2404.11313/) (2024)
- [FineVQ: Fine-Grained User Generated Content Video Quality Assessment](https://mlsanity.com/paper/2412.19238/) (2024)
- [Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessment](https://mlsanity.com/paper/2207.03723/) (2022)
- [Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterion](https://mlsanity.com/paper/2302.13269/) (2023)
- [CONVIQT: Contrastive Video Quality Estimator](https://mlsanity.com/paper/2206.14713/) (2022)
- [PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wild](https://mlsanity.com/paper/2405.17765/) (2024)
- [Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessment](https://mlsanity.com/paper/2304.14672/) (2023)
- [Video Quality Assessment: A Comprehensive Survey](https://mlsanity.com/paper/2412.04508/) (2024)
- [FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessment](https://mlsanity.com/paper/2504.09255/) (2025)
- [MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration](https://mlsanity.com/paper/2510.08508/) (2025)
- [CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelings](https://mlsanity.com/paper/2311.07090/) (2023)
- [CLIPVQA:Video Quality Assessment via CLIP](https://mlsanity.com/paper/2407.04928/) (2024)
- [Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancement](https://mlsanity.com/paper/2302.11464/) (2023)
- [AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmark](https://mlsanity.com/paper/2503.14064/) (2025)
- [VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Results](https://mlsanity.com/paper/2509.02969/) (2025)
- [HVS Revisited: A Comprehensive Video Quality Assessment Framework](https://mlsanity.com/paper/2210.04158/) (2022)
- [Delving Deep into Engagement Prediction of Short Videos](https://mlsanity.com/paper/2410.00289/) (2024)
- [RGC-VQA: An Exploration Database for Robotic-Generated Video Quality Assessment](https://mlsanity.com/paper/2506.23852/) (2025)
- [Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment](https://mlsanity.com/paper/2209.05321/) (2022)
- [Mitigating Perception Bias: A Training-Free Approach to Enhance LMM for Image Quality Assessment](https://mlsanity.com/paper/2411.12791/) (2024)
- [Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation](https://mlsanity.com/paper/2508.06092/) (2025)
- [DHQA-4D: Perceptual Quality Assessment of Dynamic 4D Digital Human](https://mlsanity.com/paper/2510.03874/) (2025)
- [The Loop Game: Quality Assessment and Optimization for Low-Light Image Enhancement](https://mlsanity.com/paper/2202.09738/) (2022)
- [Deep Quality Assessment of Compressed Videos: A Subjective and Objective Study](https://mlsanity.com/paper/2205.03630/) (2022)

## Abstract (arXiv)

In this work, we propose a no-reference video quality assessment method, aiming to achieve high-generalization capability in cross-content, -resolution and -frame rate quality prediction. In particular, we evaluate the quality of a video by learning effective feature representations in spatial-temporal domain. In the spatial domain, to tackle the resolution and content variations, we impose the Gaussian distribution constraints on the quality features. The unified distribution can significantly reduce the domain gap between different video samples, resulting in a more generalized quality feature representation. Along the temporal dimension, inspired by the mechanism of visual perception, we propose a pyramid temporal aggregation module by involving the short-term and long-term memory to aggregate the frame-level quality. Experiments show that our method outperforms the state-of-the-art methods on cross-dataset settings, and achieves comparable performance on intra-dataset configurations, demonstrating the high-generalization capability of the proposed method.
