mlsanityData to 7 Oct 2026

Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory

arXiv 2602.02393 ↗First posted 2 Feb 2026cs.CV cs.AIcited by 37

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We propose Infinite-World, a robust interactive world model capable of maintaining coherent visual memory over 1000+ frames in complex real-world environments. While existing world models can be efficiently optimized on synthetic data with perfect ground-truth, they lack an effective training paradigm for real-world videos due to noisy pose estimations and the scarcity of viewpoint revisits. To bridge this gap, we first introduce a Hierarchical Pose-free Memory Compressor (HPMC) that recursively distills historical latents into a fixed-budget representation. By jointly optimizing the compressor with the generative backbone, HPMC enables the model to autonomously anchor generations in the distant past with bounded computational cost, eliminating the need for explicit geometric priors. Second, we propose an Uncertainty-aware Action Labeling module that discretizes continuous motion into a tri-state logic. This strategy maximizes the utilization of raw video data while shielding the deterministic action space from being corrupted by noisy trajectories, ensuring robust action-response learning. Furthermore, guided by insights from a pilot toy study, we employ a Revisit-Dense Finetuning Strategy using a compact, 30-minute dataset to efficiently activate the model's long-range loop-closure capabilities. Extensive experiments, including objective metrics and user studies, demonstrate that Infinite-World achieves superior performance in visual quality, action controllability, and spatial consistency.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 31 of its 37 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

31 of 37 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  2. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  3. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  4. 2025Yume: An Interactive World Generation Model23 Jul
  5. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  6. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  8. 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
  9. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  10. 2023Learning Interactive Real-World Simulators9 Oct
  11. 2022Scalable Diffusion Models with Transformers19 Dec
  12. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov

Other references · 19

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  5. 2018World Modelscited by 1,444
  6. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
  7. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  8. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  9. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
  10. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  11. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  12. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
7 more
  1. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  2. 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 32
  3. 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
  4. 2024SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generationcited by 28
  5. 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
  6. 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 13
  7. 2025Generating Multimodal Driving Scenes via Next-Scene Predictioncited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 37.

37 papers.

Sort:

By area:

  1. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
  2. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
  3. 2026MIND: Benchmarking Memory Consistency and Action Control in World Modelscited by 31
  4. 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 20
  5. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
  6. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
  7. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
  8. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
  9. 2026Mode Seeking meets Mean Seeking for Fast Long Video Generationcited by 12
  10. 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
  11. 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 12
  12. 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
25 more
  1. 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
  2. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 9
  3. 2026Code World Model: Coding Agent as World Braincited by 9
  4. 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
  5. 2026The DAWN of World-Action Interactive Modelscited by 7
  6. 2026Geometry-Aware Implicit Memory for Video World Modelscited by 7
  7. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
  8. 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
  9. 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 4
  10. 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 4
  11. 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 4
  12. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  13. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
  14. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 3
  15. 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 3
  16. 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generationcited by 2
  17. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 2
  18. 2026Sekai2: From World Exploration to Interactive World Modelingcited by 2
  19. 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Modelscited by 2
  20. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  21. 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Modelcited by 0
  22. 2026WorldReward: Reward Modeling for Camera-Conditioned World Modelscited by 0
  23. 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
  24. 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
  25. 2026Memorizon: Training World Models Beyond Their Context Windowcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
  2. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
  3. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
  4. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  5. 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
  6. 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
  7. 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory
  8. 2026LIVE: Long-horizon Interactive Video World Modeling