mlsanityData to 7 Oct 2026

WorldOlympiad: Can Your World Model Survive a Triathlon?

arXiv 2606.11129 ↗First posted 9 Jun 2026cs.CVcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We introduce WorldOlympiad, a benchmark for diagnosing video-based world models across physical faithfulness, geometric consistency, and interaction fidelity. While existing benchmarks often focus on visual quality, semantic alignment, or short-term temporal coherence, they provide limited insight into whether generated videos obey physical rules, preserve coherent 3D structure, and sustain controllable interactions over long horizons. To address this gap, WorldOlympiad decomposes world-model evaluation into three complementary dimensions. The physical track uses object segmentation and MLLM-as-judge to assess whether generated videos follow interpretable rules in mechanics, thermal phenomena, and material properties. The geometry track reconstructs generated videos with Gaussian splatting and evaluates structural consistency, cross-view coherence, and camera-trajectory alignment. The interaction track assesses whether generated rollouts follow complex action prompts and maintain smooth, coherent transitions across consecutive video chunks. WorldOlympiad further covers three major downstream scenarios, including gaming, robotics, and general real-world videos, capturing diverse challenges from interactive control and embodied manipulation to open-domain motion and camera dynamics. Together, these tracks and scenarios form a scalable and interpretable evaluation suite that exposes failure modes beyond generic video quality. Experiments on state-of-the-art models reveal substantial gaps in physical reasoning, 3D consistency, and long-horizon interaction, underscoring the need for more structured evaluation protocols for generative world models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 50 of its 53 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

50 of 53 references.

Closest ancestors · 24

Same direction, newest first

  1. 2026Latent Spatial Memory for Video World Models8 Jun
  2. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  3. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
  4. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
  5. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
  6. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  7. 2026Advancing Open-source World Models28 Jan
  8. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  9. 2025LongCat-Video Technical Report25 Oct
  10. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  11. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  12. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
12 more
  1. 2025Yume: An Interactive World Generation Model23 Jul
  2. 2025Video World Models with Long-term Spatial Memory5 Jun
  3. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
  4. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  7. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  8. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb

Other references · 26

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2025SAM 3: Segment Anything with Conceptscited by 835
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  8. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  9. 2025Video models are zero-shot learners and reasonerscited by 208
  10. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  11. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  12. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
14 more
  1. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  2. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  3. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  4. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  5. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  6. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  7. 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
  8. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  9. 2026Rethinking Video Generation Model for the Embodied Worldcited by 30
  10. 2024LVD-2M: A Long-take Video Dataset with Temporally Dense Captionscited by 24
  11. 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
  12. 2026RISE-Video: Can Video Generators Decode Implicit World Rules?cited by 10
  13. 2026World-R1: Reinforcing 3D Constraints for Text-to-Video Generationcited by 6
  14. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Models' Last Exam in Physics
  2. 2026Quantitative Video World Model Evaluation for Geometric-Consistency
  3. 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
  4. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
  5. 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction
  6. 2026Reference-Free Assessment of Physical Consistency in World Model-based Video Generation
  7. 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models
  8. 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation