iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks large-scale datasets and unified benchmarks to evaluate their physical interaction capabilities. To address this, we propose iWorld-Bench, a comprehensive benchmark for training and testing world models on interaction-related abilities such as distance perception and memory. We construct a diverse dataset with 330k video clips and select 2.1k high-quality samples covering varied perspectives, weather, and scenes. As existing world models differ in interaction modalities, we introduce an Action Generation Framework to unify evaluation and design six task types, generating 4.9k test samples. These tasks jointly assess model performance across visual generation, trajectory following, and memory. Evaluating 14 representative world models, we identify key limitations and provide insights for future research. The iWorld-Bench model leaderboard is publicly available at iWorld-Bench.com.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 47 of its 63 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
47 of 63 references.
Closest ancestors · 9
Same direction, newest first
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Astra: General Interactive World Model with Autoregressive Denoising9 Dec
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 38
- 2024GPT-4o System Cardcited by 4,588
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2018World Modelscited by 1,513
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2024Navigation World Modelscited by 272
26 more
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 167
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 120
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
- 2024World Models for Autonomous Driving: An Initial Surveycited by 80
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 68
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environmentcited by 42
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
- 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
- 2022NTU VIRAL: A Visual-Inertial-Ranging-Lidar Dataset, From an Aerial Vehicle Viewpointcited by 29
- 2021CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Datacited by 28
- 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
- 2023MUN-FRL: A Visual Inertial LiDAR Dataset for Aerial Autonomous Navigation and Mappingcited by 5
- 2025Princeton365: A Diverse Dataset with Accurate Camera Posecited by 3
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
- 2026Current World Models Lack a Persistent State Corecited by 12
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Reportcited by 11
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agentscited by 7
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Controlcited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026Where World Models Break: Natural-Input Failure Discoverycited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
2 more
- 2026CAER: Causal Action Effect Reweighting for World Model Trainingcited by 0
- 2026HappyWorld-Benchcited by 0
- 2026HappyWorld-Bench21 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
- 2026CAER: Causal Action Effect Reweighting for World Model Training31 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Where World Models Break: Natural-Input Failure Discovery23 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report20 Jul 2026
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control4 Jul 2026
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun 2026
- 2026Current World Models Lack a Persistent State Core18 Jun 2026
- 2026Current World Models Lack a Persistent State Corecited by 12
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Reportcited by 11
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 10
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agentscited by 7
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Controlcited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026Where World Models Break: Natural-Input Failure Discoverycited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
12 most cited of 14 All 14 (JSON)
- 2026HappyWorld-Bench21 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
- 2026CAER: Causal Action Effect Reweighting for World Model Training31 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Where World Models Break: Natural-Input Failure Discovery23 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report20 Jul 2026
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control4 Jul 2026
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun 2026
- 2026Current World Models Lack a Persistent State Core18 Jun 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2025World-in-World: World Models in a Closed-Loop World
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
- 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models