mlsanityData to 14 Oct 2026

MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration

arXiv 2511.18886 ↗First posted 24 Nov 2025cs.CVcited by 3

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Recent interactive video world model methods generate scene evolution conditioned on user instructions. Although they achieve impressive results, two key limitations remain. First, they exhibit motion drift in complex environments with multiple interacting subjects, where dynamic subjects fail to follow realistic motion patterns during scene evolution. Second, they suffer from error accumulation in long-horizon interactions, where autoregressive generation gradually drifts from earlier scene states and causes structural and semantic inconsistencies. In this paper, we propose MagicWorld, an interactive video world model built upon an autoregressive framework. To address motion drift, we incorporate a flow-guided motion preservation constraint that mitigates motion degradation in dynamic subjects, encouraging realistic motion patterns and stable interactions during scene evolution. To mitigate error accumulation in long-horizon interactions, we design two complementary strategies, including a history cache retrieval strategy and an enhanced interactive training strategy. The former reinforces historical scene states by retrieving past generations during interaction, while the latter adopts multi-shot aggregated distillation with dual-reward weighting for interactive training, enhancing long-term stability and reducing error accumulation. In addition, we construct RealWM120K, a real-world dataset with diverse city-walk videos and multimodal annotations to support dynamic perception and long-horizon world modeling. Experimental results demonstrate that MagicWorld improves motion realism and alleviates error accumulation during long-horizon interactions.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 35 of its 48 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

35 of 48 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  2. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction25 Sep
  3. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  4. 2025Yume: An Interactive World Generation Model23 Jul
  5. 2025Video World Models with Long-term Spatial Memory5 Jun
  6. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  7. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  8. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  9. 2023Learning Interactive Real-World Simulators9 Oct

Other references · 26

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  4. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  5. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  7. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  8. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  9. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  10. 2025Improving Video Generation with Human Feedbackcited by 284
  11. 2024Navigation World Modelscited by 272
  12. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
14 more
  1. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  2. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  3. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  4. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 123
  5. 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
  6. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  7. 2024Video as the New Language for Real-World Decision Makingcited by 87
  8. 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 80
  9. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
  10. 2025Sekai: A Video Dataset towards World Explorationcited by 67
  11. 2024ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generationcited by 41
  12. 2022Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolutioncited by 30
  13. 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
  14. 2025Hunyuan-Game: Industrial-grade Intelligent Game Creation Modelcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generation
  2. 2026LIVE: Long-horizon Interactive Video World Modeling
  3. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  4. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
  5. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
  6. 2025RELIC: Interactive Video World Model with Long-Horizon Memory
  7. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  8. 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models