VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
Not on the map. Why?
Abstract (arXiv)
We introduce VGA-BenchV2, an extended human-aligned benchmark and optimization framework for jointly evaluating and improving video generation quality and aesthetic value. Built upon VGA-Bench, VGA-BenchV2 preserves the original fine-grained taxonomy with two primary dimensions-Aesthetic and Generation-and 52 sub-dimensions. Guided by this taxonomy, we curate 1,016 diverse prompts and collect over 60,000 videos generated by 12 mainstream video generation models. More importantly, VGA-BenchV2 substantially expands human-labeled supervision by adding 36,000 task-level annotations, including 16,200 for aesthetic quality, 13,200 for aesthetic tagging, and 6,600 for generation quality, corresponding to 13.46x, 11.15x, and 1.55x scale-ups over VGA-Bench, respectively. Leveraging this enlarged annotation corpus, we develop a hybrid evaluator architecture consisting of VAQA-Net for continuous aesthetic scoring and two Qwen-based Large Vision-Language Model evaluators, VTag-Net and VGQA-Net, for aesthetic tagging and generation quality assessment. Extensive experiments demonstrate strong alignment with human judgments across diverse generation models. Beyond evaluation, VGA-BenchV2 further introduces an evaluation-to-optimization pipeline, where the learned aesthetic evaluator serves as a reward model for reinforcement learning-based generator fine-tuning. This closes the loop from benchmark construction and human supervision to automated evaluation and model optimization, enabling video generators to improve not only in realism but also in aesthetic quality and human preference alignment. Resources are available at https://huggingface.co/datasets/BestiVictoryLab/VGA-Bench.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 39 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
30 of 39 references.
References · 30
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021Video Swin Transformercited by 1,090
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
18 more
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2022VLP: A Survey on Vision-Language Pre-trainingcited by 159
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2022Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbonecited by 109
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2022Video Transformers: A Surveycited by 63
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
- 2025Human-Centric Foundation Models: Perception, Generation and Agentic Modelingcited by 10
- 2025VADB: A Large-Scale Video Aesthetic Database with Professional and Multi-Dimensional Annotationscited by 8
- 2026VGA-Bench: A Unified Benchmark and Multi-Model Framework for Video Aesthetics and Generation Quality Evaluationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Video-Bench: Human-Aligned Video Generation Benchmark
- 2025VideoScore2: Think before You Score in Generative Video Evaluation
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models
- 2026EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedback
- 2026VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation
- 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoring
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing