mlsanityData to 14 Oct 2026

WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models

arXiv 2606.31672 ↗First posted 30 Jun 2026cs.CV cs.AIcited by 10

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Despite rapid progress in interactive world models (IWMs), short-horizon performance does not establish sustained action following, visual stability, physical plausibility, or memory. We introduce WorldRoamBench, an open-world benchmark for long-horizon stability across four dimensions, each with innovations: (i) Action: per-frame action metric bypassing cross-model semantic scale disparity and exposing failures hidden by trajectory; (ii) Vision: sliding-window drift metric capturing non-monotonic mid-sequence collapse missed by start-vs-end comparisons; (iii) Physics: evaluation of physical plausibility across mechanics, optics, and 3D consistency, gated by camera-motion and subject-tracking checks; (iv) Memory: a trajectory-aware protocol reducing confounding from action-following errors, evaluating scene memory via transition-localized 3D point-cloud reconstruction and subject memory via tracking-plus-VLM reasoning. The benchmark comprises 1000+ test cases across Nature, Urban, and Indoor scenes in first/third-person views with WASD 10-60 s continuous interaction. Evaluating 10+ open/closed-source models reveals none reliably satisfies all dimensions; even the best achieves only moderate scores. Advances on WorldRoamBench are steps toward IWMs that are stable, physically grounded, memory-faithful, and deployable in real-world applications.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 45 of its 68 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

45 of 68 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun
  2. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
  3. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  4. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  5. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
  6. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
  7. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  8. 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPG24 Mar
  9. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
  10. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
  11. 2026Advancing Open-source World Models28 Jan
  12. 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World11 Dec
6 more
  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  2. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
  3. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  4. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  5. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  6. 2024Genie: Generative Interactive Environments23 Feb

Other references · 27

  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  7. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  8. 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
  9. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  10. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
  11. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  12. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
15 more
  1. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  2. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  3. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  4. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  5. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  6. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  7. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
  8. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  9. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  10. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
  11. 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 24
  12. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
  13. 2024ACT-Bench: Towards Action Controllable World Models for Autonomous Drivingcited by 14
  14. 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
  15. 2025What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent Capabilitiescited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Current World Models Lack a Persistent State Core
  2. 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
  3. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
  4. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  5. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  6. 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models
  7. 2026Sekai2: From World Exploration to Interactive World Modeling
  8. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling