Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
We propose Infinite-World, a robust interactive world model capable of maintaining coherent visual memory over 1000+ frames in complex real-world environments. While existing world models can be efficiently optimized on synthetic data with perfect ground-truth, they lack an effective training paradigm for real-world videos due to noisy pose estimations and the scarcity of viewpoint revisits. To bridge this gap, we first introduce a Hierarchical Pose-free Memory Compressor (HPMC) that recursively distills historical latents into a fixed-budget representation. By jointly optimizing the compressor with the generative backbone, HPMC enables the model to autonomously anchor generations in the distant past with bounded computational cost, eliminating the need for explicit geometric priors. Second, we propose an Uncertainty-aware Action Labeling module that discretizes continuous motion into a tri-state logic. This strategy maximizes the utilization of raw video data while shielding the deterministic action space from being corrupted by noisy trajectories, ensuring robust action-response learning. Furthermore, guided by insights from a pilot toy study, we employ a Revisit-Dense Finetuning Strategy using a compact, 30-minute dataset to efficiently activate the model's long-range loop-closure capabilities. Extensive experiments, including objective metrics and user studies, demonstrate that Infinite-World achieves superior performance in visual quality, action controllability, and spatial consistency.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 31 of its 37 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
31 of 37 references.
Closest ancestors · 12
Same direction, newest first
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2023Learning Interactive Real-World Simulators9 Oct
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
Other references · 19
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2018World Modelscited by 1,444
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
7 more
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 32
- 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
- 2024SlowFast-VGen: Slow-Fast Learning for Action-Driven Long Video Generationcited by 28
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 13
- 2025Generating Multimodal Driving Scenes via Next-Scene Predictioncited by 12
Built on by
Citing papers per year: 2026: 37.
37 papers.
Sort:
By area:
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Modelscited by 31
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 20
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
- 2026Mode Seeking meets Mean Seeking for Fast Long Video Generationcited by 12
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
- 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 12
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
25 more
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 9
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
- 2026The DAWN of World-Action Interactive Modelscited by 7
- 2026Geometry-Aware Implicit Memory for Video World Modelscited by 7
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 4
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 4
- 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 4
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worldscited by 3
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 3
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generationcited by 2
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 2
- 2026Sekai2: From World Exploration to Interactive World Modelingcited by 2
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Modelscited by 2
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Modelcited by 0
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Modelscited by 0
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
- 2026Memorizon: Training World Models Beyond Their Context Windowcited by 0
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models27 Aug 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
25 more
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul 2026
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model29 Jun 2026
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory16 Jun 2026
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model8 Jun 2026
- 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation1 Jun 2026
- 2026Geometry-Aware Implicit Memory for Video World Models1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May 2026
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May 2026
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models18 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026The DAWN of World-Action Interactive Models12 May 2026
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr 2026
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar 2026
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generation24 Mar 2026
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokens12 Mar 2026
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines3 Mar 2026
- 2026Mode Seeking meets Mean Seeking for Fast Long Video Generation27 Feb 2026
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Modelscited by 31
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 9
- 2026Code World Model: Coding Agent as World Braincited by 9
12 most cited of 32 All 32 (JSON)
- 2026Memorizon: Training World Models Beyond Their Context Window30 Sep 2026
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models27 Aug 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
12 newest of 32 All 32 (JSON)
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 20
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generationcited by 2
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generation24 Mar 2026
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokens12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
- 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory
- 2026LIVE: Long-horizon Interactive Video World Modeling