Temporal Inconsistency Guidance for Super-resolution Video Quality Assessment
Not on the map. Why?
Abstract (arXiv)
As super-resolution (SR) techniques introduce unique distortions that fundamentally differ from those caused by traditional degradation processes (e.g., compression), there is an increasing demand for specialized video quality assessment (VQA) methods tailored to SR-generated content. One critical factor affecting perceived quality is temporal inconsistency, which refers to irregularities between consecutive frames. However, existing VQA approaches rarely quantify this phenomenon or explicitly investigate its relationship with human perception. Moreover, SR videos exhibit amplified inconsistency levels as a result of enhancement processes. In this paper, we propose textitTemporal Inconsistency Guidance for Super-resolution Video Quality Assessment (TIG-SVQA) that underscores the critical role of temporal inconsistency in guiding the quality assessment of SR videos. We first design a perception-oriented approach to quantify frame-wise temporal inconsistency. Based on this, we introduce the Inconsistency Highlighted Spatial Module, which localizes inconsistent regions at both coarse and fine scales. Inspired by the human visual system, we further develop an Inconsistency Guided Temporal Module that performs progressive temporal feature aggregation: (1) a consistency-aware fusion stage in which a visual memory capacity block adaptively determines the information load of each temporal segment based on inconsistency levels, and (2) an informative filtering stage for emphasizing quality-related features. Extensive experiments on both single-frame and multi-frame SR video scenarios demonstrate that our method significantly outperforms state-of-the-art VQA approaches. The code is publicly available at https://github.com/Lighting-YXLI/TIG-SVQA-main.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 25 Dec 2024.
Builds on
18 of 45 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2017Deformable Convolutional Networkscited by 1,488
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
6 more
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2022Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelitycited by 24
- 2020Blind Quality Assessment for Image Superresolution Using Deep Two-Stream Convolutional Networkscited by 15
- 2021ERQA: Edge-Restoration Quality Assessment for Video Super-Resolutioncited by 14
- 20222BiVQA: Double Bi-LSTM based Video Quality Assessment of UGC Videoscited by 5
- 2019Video Multimethod Assessment Fusion (VMAF) on 360VR contentscited by 2
Built on by
Not cited yet.