WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Interactive world models are advancing rapidly, yet existing benchmarks cover only part of the required competencies, leaving no unified standard for systematic evaluation. To fill this gap, we introduce WBench, a comprehensive multi-turn benchmark for interactive world model evaluation along five dimensions, namely video quality, setting adherence, interaction adherence, consistency, and physics compliance. WBench contains 289 test cases and 1,058 interaction turns, where each case specifies a world setting and a multi-turn interaction sequence, covering diverse scenes, styles, subjects, and both first- and third-person perspectives, together with four interaction types, including navigation, subject action, event editing, and perspective switching. For navigation, WBench unifies text, 6-DoF pose, and discrete-action control, enabling evaluation of models with different native input interfaces. Evaluation uses 22 automatic sub-metrics that combine specialist vision models with large multimodal models, and all metrics are validated against human judgments. Across 20 state-of-the-art models, we find that no single model performs strongly across all dimensions. We provide detailed diagnostic insights into the characteristic strengths, weaknesses, and open challenges of each model. Code and data are available at https://github.com/meituan-longcat/WBench.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 50 of its 84 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
50 of 84 references.
Closest ancestors · 22
Same direction, newest first
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World11 Dec
- 2025Astra: General Interactive World Model with Autoregressive Denoising9 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models25 Nov
- 2025LongCat-Video Technical Report25 Oct
10 more
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction25 Sep
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2023Learning Interactive Real-World Simulators9 Oct
Other references · 28
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018World Modelscited by 1,513
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
16 more
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 100
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 23
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Drivingcited by 21
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 12
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
Built on by
Citing papers per year: 2026: 39.
39 papers.
Sort:
By area:
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 13
- 2026Current World Models Lack a Persistent State Corecited by 12
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 6
- 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)cited by 6
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 4
27 more
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 4
- 2026WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Modelscited by 3
- 2026CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?cited by 3
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflowscited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026Einstein World Modelscited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
- 2026HappyWorld-Benchcited by 0
- 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamicscited by 0
- 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Modelscited by 0
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
- 2026HelixWorld: A Real-time Interactive Audio-Visual World Modelcited by 0
- 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
- 2026Towards Subject Consistency over Dynamic Subject Sets in Video Generationcited by 0
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generationcited by 0
- 2026ROWBench: Do Video Models Render What the Program Specifies?cited by 0
- 2026Code2Games: Enabling Coding Agents for Gaming World Generationcited by 0
- 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Cachingcited by 0
- 2026VIS-Ground: Video Interactive Storytelling with Contextual Groundingcited by 0
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Modelscited by 0
- 2026Generative World Simulation with DAO and JINGcited by 0
- 2026Generative World Simulation with DAO and JING14 Oct 2026
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models13 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026VIS-Ground: Video Interactive Storytelling with Contextual Grounding7 Oct 2026
- 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching6 Oct 2026
- 2026Code2Games: Enabling Coding Agents for Gaming World Generation4 Oct 2026
- 2026ROWBench: Do Video Models Render What the Program Specifies?1 Oct 2026
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation1 Oct 2026
- 2026Towards Subject Consistency over Dynamic Subject Sets in Video Generation1 Oct 2026
- 2026LOCI: Spatial Linear Memory for Streaming World Models30 Sep 2026
- 2026HelixWorld: A Real-time Interactive Audio-Visual World Model29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
27 more
- 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamics27 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation17 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows14 Sep 2026
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval10 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?17 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug 2026
- 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)13 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Models5 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun 2026
- 2026Einstein World Models25 Jun 2026
- 2026Current World Models Lack a Persistent State Core18 Jun 2026
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun 2026
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun 2026
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 13
- 2026Current World Models Lack a Persistent State Corecited by 12
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 6
- 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)cited by 6
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 4
12 most cited of 31 All 31 (JSON)
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models13 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching6 Oct 2026
- 2026ROWBench: Do Video Models Render What the Program Specifies?1 Oct 2026
- 2026LOCI: Spatial Linear Memory for Streaming World Models30 Sep 2026
- 2026HelixWorld: A Real-time Interactive Audio-Visual World Model29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamics27 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation17 Sep 2026
12 newest of 31 All 31 (JSON)
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
- 2026Towards Subject Consistency over Dynamic Subject Sets in Video Generationcited by 0
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generationcited by 0
- 2026VIS-Ground: Video Interactive Storytelling with Contextual Groundingcited by 0
- 2026Generative World Simulation with DAO and JINGcited by 0
- 2026Generative World Simulation with DAO and JING14 Oct 2026
- 2026VIS-Ground: Video Interactive Storytelling with Contextual Grounding7 Oct 2026
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation1 Oct 2026
- 2026Towards Subject Consistency over Dynamic Subject Sets in Video Generation1 Oct 2026
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval10 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
- 2026Sekai2: From World Exploration to Interactive World Modeling
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
- 2026World in World: Explore the World with World Models
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models