VGA-Bench: A Unified Benchmark and Multi-Model Framework for Video Aesthetics and Generation Quality Evaluation
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks remain largely focused on technical fidelity, leaving a significant gap in holistic assessment-particularly with respect to perceptual and artistic qualities. To address this limitation, we introduce VGA-Bench, a unified benchmark for joint evaluation of video generation quality and aesthetic quality. VGA-Bench is built upon a principled three-tier taxonomy: Aesthetic Quality, Aesthetic Tagging, and Generation Quality, each decomposed into multiple fine-grained sub-dimensions to enable systematic assessment. Guided by this taxonomy, we design 1,016 diverse prompts and generate a large-scale dataset of over 60,000 videos using 12 video generation models, ensuring broad coverage across content, style, and artifacts. To enable scalable and automated evaluation, we annotate a subset of the dataset via human labeling and develop three dedicated multi-task neural assessors: VAQA-Net for aesthetic quality prediction, VTag-Net for automatic aesthetic tagging, and VGQA-Net for generation and basic quality attributes. Extensive experiments demonstrate that our models achieve reliable alignment with human judgments, offering both accuracy and efficiency. We release VGA-Bench as a public benchmark to foster research in AIGC evaluation, with applications in content moderation, model debugging, and generative model optimization.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 43 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
38 of 43 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
26 more
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021Video Swin Transformercited by 1,090
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2022VLP: A Survey on Vision-Language Pre-trainingcited by 159
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
- 2022Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbonecited by 109
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2022Video Transformers: A Surveycited by 63
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
- 2025Human-Centric Foundation Models: Perception, Generation and Agentic Modelingcited by 10
- 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotationscited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.