Advancing Video Quality Assessment for AIGC
Not on the map. Why?
Abstract (arXiv)
In recent years, AI generative models have made remarkable progress across various domains, including text generation, image generation, and video generation. However, assessing the quality of text-to-video generation is still in its infancy, and existing evaluation frameworks fall short when compared to those for natural videos. Current video quality assessment (VQA) methods primarily focus on evaluating the overall quality of natural videos and fail to adequately account for the substantial quality discrepancies between frames in generated videos. To address this issue, we propose a novel loss function that combines mean absolute error with cross-entropy loss to mitigate inter-frame quality inconsistencies. Additionally, we introduce the innovative S2CNet technique to retain critical content, while leveraging adversarial training to enhance the model's generalization capabilities. Experimental results demonstrate that our method outperforms existing VQA techniques on the AIGC Video dataset, surpassing the previous state-of-the-art by 3.1% in terms of PLCC.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
26 of 35 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2017Mask R-CNNcited by 7,277
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022A ConvNet for the 2020scited by 3,579
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2015Fast R-CNNcited by 2,933
14 more
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2022Video Diffusion Modelscited by 2,305
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2016Generating Videos with Scene Dynamicscited by 376
- 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2024Spatial-Semantic Collaborative Cropping for User Generated Contentcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.