mlsanityData to 14 Oct 2026

iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework

arXiv 2605.03941 ↗First posted 5 May 2026cs.CV cs.AIcited by 14

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks large-scale datasets and unified benchmarks to evaluate their physical interaction capabilities. To address this, we propose iWorld-Bench, a comprehensive benchmark for training and testing world models on interaction-related abilities such as distance perception and memory. We construct a diverse dataset with 330k video clips and select 2.1k high-quality samples covering varied perspectives, weather, and scenes. As existing world models differ in interaction modalities, we introduce an Action Generation Framework to unify evaluation and design six task types, generating 4.9k test samples. These tasks jointly assess model performance across visual generation, trajectory following, and memory. Evaluating 14 representative world models, we identify key limitations and provide insights for future research. The iWorld-Bench model leaderboard is publicly available at iWorld-Bench.com.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 47 of its 63 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

47 of 63 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  2. 2025Astra: General Interactive World Model with Autoregressive Denoising9 Dec
  3. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  4. 2025Yume: An Interactive World Generation Model23 Jul
  5. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  7. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  8. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug

Other references · 38

  1. 2024GPT-4o System Cardcited by 4,588
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2018World Modelscited by 1,513
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  7. 2023Mastering Diverse Domains through World Modelscited by 1,253
  8. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  9. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  10. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  11. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  12. 2024Navigation World Modelscited by 272
26 more
  1. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  2. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 167
  3. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  4. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  5. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  6. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  7. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  8. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 120
  9. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
  10. 2024World Models for Autonomous Driving: An Initial Surveycited by 80
  11. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  12. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  13. 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
  14. 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 68
  15. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
  16. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
  17. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
  18. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  19. 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environmentcited by 42
  20. 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
  21. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
  22. 2022NTU VIRAL: A Visual-Inertial-Ranging-Lidar Dataset, From an Aerial Vehicle Viewpointcited by 29
  23. 2021CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Datacited by 28
  24. 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
  25. 2023MUN-FRL: A Visual Inertial LiDAR Dataset for Aerial Autonomous Navigation and Mappingcited by 5
  26. 2025Princeton365: A Diverse Dataset with Accurate Camera Posecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

Similar, not cited

Close in wording, no citation either way

  1. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  2. 2025World-in-World: World Models in a Closed-Loop World
  3. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
  4. 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
  5. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
  6. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
  7. 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
  8. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models