mlsanityData to 7 Oct 2026

MIND: Benchmarking Memory Consistency and Action Control in World Models

arXiv 2602.08025 ↗First posted 8 Feb 2026cs.CV cs.AIcited by 31

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models aim to understand, remember, and predict dynamic visual environments, yet a unified benchmark for evaluating their fundamental abilities remains lacking. To address this gap, we introduce MIND, the first open-domain closed-loop revisited benchmark for evaluating Memory consIstency and action coNtrol in worlD models. MIND contains 250 high-quality videos at 1080p and 24 FPS, including 100 (first-person) + 100 (third-person) video clips under a shared action space and 25 + 25 clips across varied action spaces covering eight diverse scenes. We design an efficient evaluation framework to measure two core abilities: memory consistency and action control, capturing temporal stability and contextual coherence across viewpoints. Furthermore, we design various action spaces, including different character movement speeds and camera rotation angles, to evaluate the action generalization capability across different action spaces under shared scenes. To facilitate future performance benchmarking on MIND, we introduce MIND-World, a novel interactive Video-to-World baseline. Extensive experiments demonstrate the completeness of MIND and reveal key challenges in current world models, including the difficulty of maintaining long-term memory consistency and generalizing across action spaces. Code: https://github.com/CSU-JPG/MIND.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 40 of its 48 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

40 of 48 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  2. 2026Advancing Open-source World Models28 Jan
  3. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  4. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  5. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  6. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  7. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  8. 2025Yume: An Interactive World Generation Model23 Jul
  9. 2025Video World Models with Long-term Spatial Memory5 Jun
  10. 2025LoopNav: Benchmarking Spatial Consistency in World Models29 May
  11. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
7 more
  1. 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
  2. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  4. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2024Genie: Generative Interactive Environments23 Feb
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov

Other references · 21

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  7. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  8. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  9. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  10. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  11. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  12. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 127
9 more
  1. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
  2. 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 108
  3. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  4. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  5. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  6. 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 45
  7. 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
  8. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  9. 2025Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Modelscited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 31.

31 papers.

Sort:

By area:

  1. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
  2. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
  3. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 20
  4. 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPGcited by 13
  5. 2026Addressable Memory for Video World Modelscited by 11
  6. 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
  7. 2026Olaf-World: Orienting Latent Actions for Video World Modelingcited by 8
  8. 2026Current World Models Lack a Persistent State Corecited by 8
  9. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 8
  10. 2026Geometry-Aware Implicit Memory for Video World Modelscited by 7
  11. 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 7
  12. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
19 more
  1. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
  2. 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearancecited by 5
  3. 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 4
  4. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  5. 2026World Models as Group Actionscited by 3
  6. 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
  7. 2026ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadowcited by 2
  8. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 2
  9. 2026WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Modelscited by 2
  10. 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
  11. 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
  12. 2026Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?cited by 0
  13. 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
  14. 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Modelscited by 0
  15. 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
  16. 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
  17. 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
  18. 2026ROWBench: Do Video Models Render What the Program Specifies?cited by 0
  19. 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
  2. 2026Echo-Memory: A Controlled Study of Memory in Action World Models
  3. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models
  4. 2026Wonder: Video World Model Done Better
  5. 2026ReWorld: An Interactive World Model with Long-Horizon Memory
  6. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
  7. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
  8. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models