mlsanityData to 7 Oct 2026

DiVid: Diagnosing Dimension-Specific Diversity Collapse in Video Generation Models

arXiv 2610.01661 ↗First posted 1 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite remarkable progress, video generation models often produce highly similar outputs when repeatedly sampled from the same prompt, limiting their usefulness for creative exploration. Existing diversity evaluations primarily rely on global scalar metrics, which obscure where diversity collapses in the spatiotemporal space of videos. We introduce DiVid, a dimension-level diagnostic framework that decomposes video generation diversity into six interpretable dimensions: Semantic, Style, Subject, Scene, Motion, and Camera. Each dimension is measured through a reproducible computer-vision pipeline and analyzed alongside quality and instruction faithfulness to examine potential trade-offs. Systematic evaluation of representative video generation models reveals that diversity is highly dimension-specific: models with strong global diversity scores still collapse on specific factors, particularly Motion and Camera. These rankings persist after filtering unfaithful generations, indicating genuine capability differences rather than off-prompt outputs. Beyond measurement, controlled prompt interventions identify two fundamental bottlenecks: default mode convergence, where models fall back to dominant patterns under open-ended prompts; and realization gaps, where models fail to faithfully realize diverse, explicitly requested alternatives, particularly for temporal factors. The larger faithfulness losses for temporal factors highlight the difficulty of controlling motion and camera variation through text alone. DiVid thus shifts the study of diversity from measuring whether it exists to diagnosing where and why it collapses, and provides actionable directions for dimension-aware training objectives and control signals. The framework will be released to facilitate future research on diverse and controllable video generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 71 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

58 of 71 references.

References · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  8. 2022Video Diffusion Modelscited by 2,280
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  11. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  12. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
38 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  2. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  3. 2023CoTracker: It is Better to Track Togethercited by 516
  4. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  5. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  6. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  7. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  8. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  9. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 225
  10. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  11. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  12. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  13. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  14. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
  15. 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 124
  16. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
  17. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
  18. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  19. 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
  20. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
  21. 2025Towards Understanding Camera Motions in Any Videocited by 62
  22. 2023Class-Balancing Diffusion Modelscited by 47
  23. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
  24. 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 35
  25. 2024Image Generation Diversity Issues and How to Tame Themcited by 22
  26. 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 19
  27. 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
  28. 2025DiverseGRPO: Mitigating Mode Collapse in Image Generation via Diversity-Aware GRPOcited by 16
  29. 2024Measuring Diversity in Co-creative Image Generationcited by 15
  30. 2024Scendi Score: Prompt-Aware Diversity Evaluation via Schur Complement of CLIP Embeddingscited by 15
  31. 2025SPARKE: Scalable Prompt-Aware Diversity and Novelty Guidance in Diffusion Models via RKE Scorecited by 14
  32. 2024Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Modelscited by 13
  33. 2025Guidance in the Frequency Domain Enables High-Fidelity Sampling at Low CFG Scalescited by 13
  34. 2023MOSO: Decomposing MOtion, Scene and Object for Video Predictioncited by 12
  35. 2024Conditional Vendi Score: Prompt-Aware Diversity Evaluation for Generative AI Models and LLMscited by 6
  36. 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
  37. 2025The Intricate Dance of Prompt Complexity, Quality, Diversity, and Consistency in T2I Modelscited by 6
  38. 2026Evolution of Video Generative Foundationscited by 6

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.