mlsanityData to 7 Oct 2026

Knowledge-Intensive Video Generation

arXiv 2606.01285 ↗First posted 31 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-video generation has advanced rapidly in visual quality, but remains under-evaluated for factuality and practical usefulness. We introduce knowledge-intensive video generation (KIVI), where models generate videos from short information-seeking prompts that ask for explanations, procedures, or demonstrations. To evaluate this setting, we construct KIVI-Bench, a benchmark of 1,080 prompts, and propose automatic metrics for factuality and helpfulness. Human evaluation shows that our metrics significantly better align with human annotations than existing alternatives. Experiments on seven state-of-the-art video generation models show that current systems still lag behind human performance, especially on visual properties, procedural operations, and clear information presentation. These results highlight KIVI as a challenging direction for factual and instructionally useful video generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

38 of 54 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  7. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  8. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  9. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
  10. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  11. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  12. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
26 more
  1. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  2. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  3. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  4. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  5. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  6. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 203
  7. 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
  8. 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 177
  9. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  10. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
  12. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  13. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
  14. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
  15. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
  16. 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 105
  17. 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
  18. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  19. 2019KnowIT VQA: Answering Knowledge-Based Questions about Videoscited by 53
  20. 2024Towards A Better Metric for Text-to-Video Generationcited by 50
  21. 2024MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videoscited by 43
  22. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
  23. 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
  24. 2023FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answeringcited by 15
  25. 2025COVE: COntext and VEracity prediction for out-of-context imagescited by 14
  26. 2025Respond Beyond Language: A Benchmark for Video Generation in Response to Realistic User Intentscited by 2

Built on by

Not cited yet.