A Survey of AI-Generated Video Evaluation
Not on the map. Why?
Abstract (arXiv)
The growing capabilities of AI in generating video content have brought forward significant challenges in effectively evaluating these videos. Unlike static images or text, video content involves complex spatial and temporal dynamics which may require a more comprehensive and systematic evaluation of its contents in aspects like video presentation quality, semantic information delivery, alignment with human intentions, and the virtual-reality consistency with our physical world. This survey identifies the emerging field of AI-Generated Video Evaluation (AIGVE), highlighting the importance of assessing how well AI-generated videos align with human perception and meet specific instructions. We provide a structured analysis of existing methodologies that could be potentially used to evaluate AI-generated videos. By outlining the strengths and gaps in current approaches, we advocate for the development of more robust and nuanced evaluation frameworks that can handle the complexities of video content, which include not only the conventional metric-based evaluations, but also the current human-involved evaluations, and the future model-centered evaluations. This survey aims to establish a foundational knowledge base for both researchers from academia and practitioners from the industry, facilitating the future advancement of evaluation methods for AI-generated video content.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Oct 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 5.
17 papers.
Sort:
By area:
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 57
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 36
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real Worldcited by 23
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 22
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metriccited by 9
- 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answeringcited by 9
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmarkcited by 7
- 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequencescited by 6
- 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluationcited by 4
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matricescited by 4
- 2025A Survey: Spatiotemporal Consistency in Video Generationcited by 3
5 more
- 2025Are AI-Generated Driving Videos Ready for Autonomous Driving? A Diagnostic Evaluation Frameworkcited by 2
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibilitycited by 1
- 2026Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluationcited by 1
- 2026Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledgecited by 0
- 2026Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modelingcited by 0
- 2026Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluation10 Aug 2026
- 2026Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling21 Jul 2026
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar 2026
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility11 Feb 2026
- 2026Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledge26 Jan 2026
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World11 Dec 2025
- 2025Are AI-Generated Driving Videos Ready for Autonomous Driving? A Diagnostic Evaluation Framework6 Dec 2025
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matrices2 Nov 2025
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Models18 Aug 2025
- 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences14 Aug 2025
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation15 Jul 2025
- 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation2 Jul 2025
5 more
- 2025Video-Bench: Human-Aligned Video Generation Benchmark7 Apr 2025
- 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering21 Mar 2025
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmark18 Mar 2025
- 2025A Survey: Spatiotemporal Consistency in Video Generation25 Feb 2025
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metric25 Nov 2024
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 22
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metriccited by 9
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmarkcited by 7
- 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluationcited by 4
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matricescited by 4
- 2025A Survey: Spatiotemporal Consistency in Video Generationcited by 3
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibilitycited by 1
- 2026Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluationcited by 1
- 2026Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledgecited by 0
- 2026Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modelingcited by 0
- 2026Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluation10 Aug 2026
- 2026Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling21 Jul 2026
- 2026OccFace: Unified Occlusion-Aware Facial Landmark Detection with Per-Point Visibility11 Feb 2026
- 2026Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledge26 Jan 2026
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matrices2 Nov 2025
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation15 Jul 2025
- 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation2 Jul 2025
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmark18 Mar 2025
- 2025A Survey: Spatiotemporal Consistency in Video Generation25 Feb 2025
- 2024Human-Activity AGV Quality Assessment: A Benchmark Dataset and an Objective Evaluation Metric25 Nov 2024