DiVid: Diagnosing Dimension-Specific Diversity Collapse in Video Generation Models
Not on the map. Why?
Abstract (arXiv)
Despite remarkable progress, video generation models often produce highly similar outputs when repeatedly sampled from the same prompt, limiting their usefulness for creative exploration. Existing diversity evaluations primarily rely on global scalar metrics, which obscure where diversity collapses in the spatiotemporal space of videos. We introduce DiVid, a dimension-level diagnostic framework that decomposes video generation diversity into six interpretable dimensions: Semantic, Style, Subject, Scene, Motion, and Camera. Each dimension is measured through a reproducible computer-vision pipeline and analyzed alongside quality and instruction faithfulness to examine potential trade-offs. Systematic evaluation of representative video generation models reveals that diversity is highly dimension-specific: models with strong global diversity scores still collapse on specific factors, particularly Motion and Camera. These rankings persist after filtering unfaithful generations, indicating genuine capability differences rather than off-prompt outputs. Beyond measurement, controlled prompt interventions identify two fundamental bottlenecks: default mode convergence, where models fall back to dominant patterns under open-ended prompts; and realization gaps, where models fail to faithfully realize diverse, explicitly requested alternatives, particularly for temporal factors. The larger faithfulness losses for temporal factors highlight the difficulty of controlling motion and camera variation through text alone. DiVid thus shifts the study of diversity from measuring whether it exists to diagnosing where and why it collapses, and provides actionable directions for dimension-aware training objectives and control signals. The framework will be released to facilitate future research on diverse and controllable video generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 71 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
58 of 71 references.
References · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
38 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 225
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
- 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 124
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
- 2025Towards Understanding Camera Motions in Any Videocited by 62
- 2023Class-Balancing Diffusion Modelscited by 47
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
- 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 35
- 2024Image Generation Diversity Issues and How to Tame Themcited by 22
- 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 19
- 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
- 2025DiverseGRPO: Mitigating Mode Collapse in Image Generation via Diversity-Aware GRPOcited by 16
- 2024Measuring Diversity in Co-creative Image Generationcited by 15
- 2024Scendi Score: Prompt-Aware Diversity Evaluation via Schur Complement of CLIP Embeddingscited by 15
- 2025SPARKE: Scalable Prompt-Aware Diversity and Novelty Guidance in Diffusion Models via RKE Scorecited by 14
- 2024Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Modelscited by 13
- 2025Guidance in the Frequency Domain Enables High-Fidelity Sampling at Low CFG Scalescited by 13
- 2023MOSO: Decomposing MOtion, Scene and Object for Video Predictioncited by 12
- 2024Conditional Vendi Score: Prompt-Aware Diversity Evaluation for Generative AI Models and LLMscited by 6
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
- 2025The Intricate Dance of Prompt Complexity, Quality, Diversity, and Consistency in T2I Modelscited by 6
- 2026Evolution of Video Generative Foundationscited by 6
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.