LoCoT2V-Bench: Benchmarking Long-Form and Complex Text-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-video generation have achieved impressive performance on short clips, yet evaluating long-form generation under complex textual inputs remains a significant challenge. In response to this challenge, we present LoCoT2V-Bench, a benchmark for long video generation (LVG) featuring multi-scene prompts with hierarchical metadata (e.g., character settings and camera behaviors), constructed from collected real-world videos. We further propose LoCoT2V-Eval, a multi-dimensional framework covering perceptual quality, text-video alignment, temporal quality, dynamic quality, and Human Expectation Realization Degree (HERD), with an emphasis on aspects such as fine-grained text-video alignment and temporal character consistency. Experiments on 17 representative LVG models reveal pronounced capability disparities across evaluation dimensions, with strong perceptual quality and background consistency but markedly weaker fine-grained text-video alignment and character consistency. These findings suggest that improving prompt faithfulness and identity preservation remains a key challenge for long-form video generation. Our code and data are released at https://github.com/XqZeppelinhead0702/LoCoT2V-Bench
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 69 of its 93 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
69 of 93 references.
References · 69
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2016Improved Techniques for Training GANscited by 2,938
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
- 2025History-Guided Video Diffusioncited by 165
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
- 2025LongCat-Video Technical Reportcited by 73
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2026Beyond Unimodal Shortcuts: MLLMs as Cross-Modal Reasoners for Grounded Named Entity Recognitioncited by 6
- 2026Mitigating Multimodal Hallucination via Phase-wise Self-rewardcited by 2
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generationcited by 0
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generation30 Aug 2026
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May 2026
- 2026Mitigating Multimodal Hallucination via Phase-wise Self-reward20 Apr 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026Beyond Unimodal Shortcuts: MLLMs as Cross-Modal Reasoners for Grounded Named Entity Recognition4 Feb 2026