Convolutions Need Registers Too: HVS-Inspired Dynamic Attention for Video Quality Assessment
Not on the map. Why?
Abstract (arXiv)
No-reference video quality assessment (NR-VQA) estimates perceptual quality without a reference video, which is often challenging. While recent techniques leverage saliency or transformer attention, they merely address global context of the video signal by using static maps as auxiliary inputs rather than embedding context fundamentally within feature extraction of the video sequence. We present Dynamic Attention with Global Registers for Video Quality Assessment (DAGR-VQA), the first framework integrating register-token directly into a convolutional backbone for spatio-temporal, dynamic saliency prediction. By embedding learnable register tokens as global context carriers, our model enables dynamic, HVS-inspired attention, producing temporally adaptive saliency maps that track salient regions over time without explicit motion estimation. Our model integrates dynamic saliency maps with RGB inputs, capturing spatial data and analyzing it through a temporal transformer to deliver a perceptually consistent video quality assessment. Comprehensive tests conducted on the LSVQ, KonVid-1k, LIVE-VQC, and YouTube-UGC datasets show that the performance is highly competitive, surpassing the majority of top baselines. Research on ablation studies demonstrates that the integration of register tokens promotes the development of stable and temporally consistent attention mechanisms. Achieving an efficiency of 387.7 FPS at 1080p, DAGR-VQA demonstrates computational performance suitable for real-time applications like multimedia streaming systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 52 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
20 of 52 references.
References · 20
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2020Unified Image and Video Saliency Modelingcited by 75
- 2018Revisiting Video Saliency: A Large-scale Benchmark and a New Modelcited by 67
- 2019TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detectioncited by 59
8 more
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024PTM-VQA: Efficient Video Quality Assessment Leveraging Diverse PreTrained Models from the Wildcited by 17
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
- 2024DiffSal: Joint Audio and Video Learning for Diffusion Saliency Predictioncited by 13
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perceptioncited by 11
- 2024ReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality Assessmentcited by 4
- 2025Video Quality Assessment for Online Processing: From Spatial to Temporal Samplingcited by 4
- 2021Where to look at the movies : Analyzing visual attention to understand movie editingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.