mlsanityData to 7 Oct 2026

4DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models

arXiv 2511.19836 ↗First posted 25 Nov 2025cs.CVcited by 10

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from images, videos, or text. These models not only need to produce high-fidelity visual content but also maintain coherence across space, time, physics, and instruction control, enabling applications in virtual reality, autonomous driving, embodied intelligence, and content creation. However, prior benchmarks emphasize different evaluation dimensions and lack a unified assessment of world-realism capability. To systematically evaluate World Models, we introduce the 4DWorldBench, which measures models across four key dimensions: Perceptual Quality, Condition-4D Alignment, Physical Realism, and 4D Consistency. The benchmark covers tasks such as Image-to-3D/4D, Video-to-4D, Text-to-3D/4D. Beyond these, we innovatively introduce adaptive conditioning across multiple modalities, which not only integrates but also extends traditional evaluation paradigms. To accommodate different modality-conditioned inputs, we map all modality conditions into a unified textual space during evaluation, and further integrate LLM-as-judge, MLLM-as-judge, and traditional network-based methods. This unified and adaptive design enables more comprehensive and consistent evaluation of alignment, physical realism, and cross-modal coherence. Preliminary human studies further demonstrate that our adaptive tool selection achieves closer agreement with subjective human judgments. We hope this benchmark will serve as a foundation for objective comparisons and improvements, accelerating the transition from "visual generation" to "world generation." Our project can be found at https://yeppp27.github.io/4DWorldBench.github.io/.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 43 of its 55 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

43 of 55 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  2. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb

Other references · 41

  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  4. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  5. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  6. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  7. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  8. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  9. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  10. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  11. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  12. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
29 more
  1. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  2. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  3. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  4. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  5. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  6. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  7. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  8. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  9. 2025Do generative video models understand physical principles?cited by 151
  10. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  11. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  12. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
  13. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  14. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  15. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  16. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  17. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  18. 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
  19. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
  20. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  21. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
  22. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  23. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 34
  24. 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
  25. 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 29
  26. 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
  27. 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 15
  28. 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 11
  29. 2025WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenescited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Models
  2. 2025From 2D to 3D Cognition: A Brief Survey of General World Models
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulators
  4. 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
  5. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction
  6. 2025UniFuture: A 4D Driving World Model for Future Generation and Perception
  7. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
  8. 20264DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation