mlsanityData to 14 Oct 2026

Are Video Models Zero-Shot Learners and Reasoners in Education? EduVideoBench, A Knowledge-Skills-Attitude Benchmark for Educational Video Generation

arXiv 2605.26918 ↗First posted 26 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Video generation models (VGMs) are rapidly entering classrooms, yet existing benchmarks evaluate only perceptual quality, intrinsic faithfulness, generic safety, or video as a reasoning medium, and none assesses whether the outputs are educationally valid. In this work, we present EduVideoBench, the first balanced benchmark in the education domain, grounded in the Knowledge-Skills-Attitude (KSA) framework so that pedagogical adequacy and educational safety are evaluated jointly rather than as ad-hoc quality dimensions. Across five frontier VGMs, our results show substantial room for improvement across knowledge, skills, and attitude before they are classroom-ready. We complement this with a qualitative analysis of expert comments, finding that educational validity is multi-component, where a single misaligned element such as pacing, legibility, or notation can invalidate an otherwise correct video. We hope EduVideoBench will guide the development of VGMs that are pedagogically grounded and safe for the classroom.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 18 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

9 of 18 references.

References · 9

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2024A Survey on LLM-as-a-Judgecited by 1,423
  3. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  4. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  5. 2025Video models are zero-shot learners and reasonerscited by 220
  6. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  7. 2026PhyEduVideo: A Benchmark for Evaluating Text-to-Video Models for Physics Educationcited by 5
  8. 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generationcited by 4
  9. 2025How Can Video Generative AI Transform K-12 Education? Examining Teachers' Perspectives through TPACK and TAMcited by 1

Built on by

Not cited yet.