4DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from images, videos, or text. These models not only need to produce high-fidelity visual content but also maintain coherence across space, time, physics, and instruction control, enabling applications in virtual reality, autonomous driving, embodied intelligence, and content creation. However, prior benchmarks emphasize different evaluation dimensions and lack a unified assessment of world-realism capability. To systematically evaluate World Models, we introduce the 4DWorldBench, which measures models across four key dimensions: Perceptual Quality, Condition-4D Alignment, Physical Realism, and 4D Consistency. The benchmark covers tasks such as Image-to-3D/4D, Video-to-4D, Text-to-3D/4D. Beyond these, we innovatively introduce adaptive conditioning across multiple modalities, which not only integrates but also extends traditional evaluation paradigms. To accommodate different modality-conditioned inputs, we map all modality conditions into a unified textual space during evaluation, and further integrate LLM-as-judge, MLLM-as-judge, and traditional network-based methods. This unified and adaptive design enables more comprehensive and consistent evaluation of alignment, physical realism, and cross-modal coherence. Preliminary human studies further demonstrate that our adaptive tool selection achieves closer agreement with subjective human judgments. We hope this benchmark will serve as a foundation for objective comparisons and improvements, accelerating the transition from "visual generation" to "world generation." Our project can be found at https://yeppp27.github.io/4DWorldBench.github.io/.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 43 of its 55 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
43 of 55 references.
Closest ancestors · 2
Same direction, newest first
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
Other references · 41
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
29 more
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2023WonderJourney: Going from Anywhere to Everywherecited by 157
- 2025Do generative video models understand physical principles?cited by 151
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
- 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 34
- 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 29
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
- 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 15
- 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 11
- 2025WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenescited by 10
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 8
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modelingcited by 1
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)cited by 1
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 1
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loopcited by 0
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop30 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May 2026
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video25 May 2026
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform18 May 2026
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)6 May 2026
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modeling3 May 2026
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr 2026
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Models
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models
- 2024WorldSimBench: Towards Video Generation Models as World Simulators
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perception
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
- 20264DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation