WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Despite rapid progress in interactive world models (IWMs), short-horizon performance does not establish sustained action following, visual stability, physical plausibility, or memory. We introduce WorldRoamBench, an open-world benchmark for long-horizon stability across four dimensions, each with innovations: (i) Action: per-frame action metric bypassing cross-model semantic scale disparity and exposing failures hidden by trajectory; (ii) Vision: sliding-window drift metric capturing non-monotonic mid-sequence collapse missed by start-vs-end comparisons; (iii) Physics: evaluation of physical plausibility across mechanics, optics, and 3D consistency, gated by camera-motion and subject-tracking checks; (iv) Memory: a trajectory-aware protocol reducing confounding from action-following errors, evaluating scene memory via transition-localized 3D point-cloud reconstruction and subject memory via tracking-plus-VLM reasoning. The benchmark comprises 1000+ test cases across Nature, Urban, and Indoor scenes in first/third-person views with WASD 10-60 s continuous interaction. Evaluating 10+ open/closed-source models reveals none reliably satisfies all dimensions; even the best achieves only moderate scores. Advances on WorldRoamBench are steps toward IWMs that are stable, physically grounded, memory-faithful, and deployable in real-world applications.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 45 of its 68 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
45 of 68 references.
Closest ancestors · 18
Same direction, newest first
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPG24 Mar
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World11 Dec
6 more
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
- 2024Genie: Generative Interactive Environments23 Feb
Other references · 27
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
15 more
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 24
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
- 2024ACT-Bench: Towards Action Controllable World Models for Autonomous Drivingcited by 14
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
- 2025What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent Capabilitiescited by 8
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 4
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026HappyWorld-Benchcited by 0
- 2026World Agent: Can Language Models Keep a World Running?cited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Modelscited by 0
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models13 Oct 2026
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout13 Oct 2026
- 2026World Agent: Can Language Models Keep a World Running?26 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Current World Models Lack a Persistent State Core
- 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models
- 2026Sekai2: From World Exploration to Interactive World Modeling
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling