mlsanityData to 14 Oct 2026

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

arXiv 2605.25874 ↗First posted 25 May 2026cs.CVcited by 39

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Interactive world models are advancing rapidly, yet existing benchmarks cover only part of the required competencies, leaving no unified standard for systematic evaluation. To fill this gap, we introduce WBench, a comprehensive multi-turn benchmark for interactive world model evaluation along five dimensions, namely video quality, setting adherence, interaction adherence, consistency, and physics compliance. WBench contains 289 test cases and 1,058 interaction turns, where each case specifies a world setting and a multi-turn interaction sequence, covering diverse scenes, styles, subjects, and both first- and third-person perspectives, together with four interaction types, including navigation, subject action, event editing, and perspective switching. For navigation, WBench unifies text, 6-DoF pose, and discrete-action control, enabling evaluation of models with different native input interfaces. Evaluation uses 22 automatic sub-metrics that combine specialist vision models with large multimodal models, and all metrics are validated against human judgments. Across 20 state-of-the-art models, we find that no single model performs strongly across all dimensions. We provide detailed diagnostic insights into the characteristic strengths, weaknesses, and open challenges of each model. Code and data are available at https://github.com/meituan-longcat/WBench.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 50 of its 84 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

50 of 84 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
  2. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  3. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
  4. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
  5. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
  6. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  7. 2026Advancing Open-source World Models28 Jan
  8. 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World11 Dec
  9. 2025Astra: General Interactive World Model with Autoregressive Denoising9 Dec
  10. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  11. 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models25 Nov
  12. 2025LongCat-Video Technical Report25 Oct
10 more
  1. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction25 Sep
  2. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  3. 2025Yume: An Interactive World Generation Model23 Jul
  4. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  7. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  10. 2023Learning Interactive Real-World Simulators9 Oct

Other references · 28

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2018World Modelscited by 1,513
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  7. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  9. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  11. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  12. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
16 more
  1. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  2. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  3. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  4. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  5. 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 100
  6. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  7. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
  8. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
  9. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  10. 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
  11. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
  12. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
  13. 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 23
  14. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Drivingcited by 21
  15. 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 12
  16. 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 39.

39 papers.

Sort:

By area:

  1. 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
  2. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
  3. 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 13
  4. 2026Current World Models Lack a Persistent State Corecited by 12
  5. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
  6. 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 6
  7. 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)cited by 6
  8. 2026A Definition and Roadmap for World Modelscited by 5
  9. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
  10. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
  11. 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
  12. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 4
27 more
  1. 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 4
  2. 2026WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Modelscited by 3
  3. 2026CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?cited by 3
  4. 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
  5. 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
  6. 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
  7. 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
  8. 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflowscited by 1
  9. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  10. 2026Einstein World Modelscited by 0
  11. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  12. 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
  13. 2026HappyWorld-Benchcited by 0
  14. 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamicscited by 0
  15. 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Modelscited by 0
  16. 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
  17. 2026HelixWorld: A Real-time Interactive Audio-Visual World Modelcited by 0
  18. 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
  19. 2026Towards Subject Consistency over Dynamic Subject Sets in Video Generationcited by 0
  20. 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generationcited by 0
  21. 2026ROWBench: Do Video Models Render What the Program Specifies?cited by 0
  22. 2026Code2Games: Enabling Coding Agents for Gaming World Generationcited by 0
  23. 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Cachingcited by 0
  24. 2026VIS-Ground: Video Interactive Storytelling with Contextual Groundingcited by 0
  25. 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
  26. 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Modelscited by 0
  27. 2026Generative World Simulation with DAO and JINGcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
  2. 2026Sekai2: From World Exploration to Interactive World Modeling
  3. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  4. 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
  5. 2026World in World: Explore the World with World Models
  6. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
  7. 2026WorldReward: Reward Modeling for Camera-Conditioned World Models
  8. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models