mlsanityData to 14 Oct 2026

HappyWorld-Bench

arXiv 2609.24308 ↗First posted 21 Sep 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators also fits: World models for language agents

Abstract (arXiv)

Evaluating world models requires assessing both the quality of the worlds they generate and their consistency and responsiveness under exploration, interaction, and modification. We introduce HappyWorld-Bench, a comprehensive benchmark that evaluates whether generated worlds remain reliable as agents interact with them. Our design is built on a hierarchical capability framework of six world capabilities (W1-W6), from generative construction to unified world modeling, instantiated across three independent evaluation tracks: video world models, spatial world models, and embodied world models. HappyWorld-Bench comprises 1,138 video prompts, 300 spatial scenes, and 254 embodied test cases. Across all three tracks, we build and operate HappyWorld-Arena to organize human A/B comparisons and derive model-level Elo ratings, which complement newly designed automated metrics that capture behavioral correctness. We evaluate 14 video world models, 9 spatial systems, and 8 embodied candidates under this unified framework. Results reveal remaining reliability gaps across all three tracks: video models exhibit reduced consistency during extended rollouts and revisits, spatial models achieve at best 70.14% placement accuracy and 73.33% edit execution, and embodied models struggle to preserve state across multi-step actions and respond precisely to altered action conditions and physical rules. These findings highlight the need to evaluate world models not only by visual quality, but also by state consistency and the correctness of their responses to actions and interventions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 96 of its 125 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

96 of 125 references.

Closest ancestors · 25

Same direction, newest first

  1. 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug
  2. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug
  3. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
  4. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  5. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun
  6. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  7. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  8. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May
  9. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  10. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  11. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
  12. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
13 more
  1. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
  2. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  3. 2026Advancing Open-source World Models28 Jan
  4. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  5. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  6. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models14 May
  7. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  8. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  10. 2024EVA: An Embodied World Model for Future Video Anticipation20 Oct
  11. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  12. 2024Genie: Generative Interactive Environments23 Feb
  13. 2023Learning Interactive Real-World Simulators9 Oct

Other references · 71

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2018World Modelscited by 1,513
  4. 2025DINOv3cited by 1,414
  5. 2023Mastering Diverse Domains through World Modelscited by 1,253
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  9. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  10. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  11. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  12. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
38 more
  1. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  2. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  3. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  4. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  5. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  6. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  7. 2022Transformers are Sample-Efficient World Modelscited by 328
  8. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  9. 2024Navigation World Modelscited by 272
  10. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 269
  11. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  12. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  13. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  14. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  15. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  16. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  17. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
  18. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  19. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  20. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
  21. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  22. 2023Learning to Act from Actionless Videos through Dense Correspondencescited by 164
  23. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  24. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  25. 2018The 2018 PIRM Challenge on Perceptual Image Super-resolutioncited by 156
  26. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  27. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
  28. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  29. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  30. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
  31. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  32. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  33. 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 69
  34. 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
  35. 2025WorldGym: World Model as An Environment for Policy Evaluationcited by 64
  36. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 61
  37. 2026Infinite Worlds with Versatile Interactionscited by 48
  38. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44

50 most cited of 71 All 71 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025World-in-World: World Models in a Closed-Loop World
  2. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
  3. 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
  4. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
  5. 2026AffectWorld: Benchmarking Emotion-Driven Future World Prediction
  6. 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
  7. 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
  8. 2026World Models as Group Actions