Priorformer: A UGC-VQA Method with content and distortion priors
Not on the map. Why?
Abstract (arXiv)
User Generated Content (UGC) videos are susceptible to complicated and variant degradations and contents, which prevents the existing blind video quality assessment (BVQA) models from good performance since the lack of the adapability of distortions and contents. To mitigate this, we propose a novel prior-augmented perceptual vision transformer (PriorFormer) for the BVQA of UGC, which boots its adaptability and representation capability for divergent contents and distortions. Concretely, we introduce two powerful priors, i.e., the content and distortion priors, by extracting the content and distortion embeddings from two pre-trained feature extractors. Then we adopt these two powerful embeddings as the adaptive prior tokens, which are transferred to the vision transformer backbone jointly with implicit quality features. Based on the above strategy, the proposed PriorFormer achieves state-of-the-art performance on three public UGC VQA datasets including KoNViD-1K, LIVE-VQC and YouTube-UGC.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 24 Jun 2024.
Builds on
18 of 30 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 166
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
6 more
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2020Transformer for Image Quality Assessmentcited by 76
- 2021GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessmentcited by 43
- 2024KVQ: Kwai Video Quality Assessment for Short-form Videoscited by 38
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2022SwinIQA: Learned Swin Distance for Compressed Image Quality Assessmentcited by 14
Built on by
Not cited yet.