mlsanityData to 14 Oct 2026

TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Model

arXiv 2601.00051 ↗First posted 31 Dec 2025cs.CVcited by 16

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models aim to endow AI systems with the ability to represent, generate, and interact with dynamic environments in a coherent and temporally consistent manner. While recent video generation models have demonstrated impressive visual quality, they remain limited in real-time interaction, long-horizon consistency, and persistent memory of dynamic scenes, hindering their evolution into practical world models. In this report, we present TeleWorld, a real-time multimodal 4D world modeling framework that unifies video generation, dynamic scene reconstruction, and long-term world memory within a closed-loop system. TeleWorld introduces a novel generation-reconstruction-guidance paradigm, where generated video streams are continuously reconstructed into a dynamic 4D spatio-temporal representation, which in turn guides subsequent generation to maintain spatial, temporal, and physical consistency. To support long-horizon generation with low latency, we employ an autoregressive diffusion-based video model enhanced with Macro-from-Micro Planning (MMPL)--a hierarchical planning method that reduces error accumulation from frame-level to segment-level-alongside efficient Distribution Matching Distillation (DMD), enabling real-time synthesis under practical computational budgets. Our approach achieves seamless integration of dynamic object modeling and static scene representation within a unified 4D framework, advancing world models toward practical, interactive, and computationally accessible systems. Extensive experiments demonstrate that TeleWorld achieves strong performance in both static and dynamic world understanding, long-term consistency, and real-time generation efficiency, positioning it as a practical step toward interactive, memory-enabled world models for multimodal generation and embodied intelligence.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 34 of its 44 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

34 of 44 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  2. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  3. 2025Yume: An Interactive World Generation Model23 Jul
  4. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar

Other references · 29

  1. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  2. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  5. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  6. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
  7. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  8. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  9. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  10. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  11. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  12. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
17 more
  1. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  2. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  3. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  4. 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
  5. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
  6. 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
  7. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
  8. 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 77
  9. 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
  10. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
  11. 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
  12. 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
  13. 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 24
  14. 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
  15. 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Controlcited by 19
  16. 20254D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimationcited by 10
  17. 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Predictioncited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
  2. 2026Geometry-Aware Implicit Memory for Video World Modelscited by 13
  3. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
  4. 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
  5. 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
  6. 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
  7. 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
  8. 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interactioncited by 4
  9. 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
  10. 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 3
  11. 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusioncited by 2
  12. 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
4 more
  1. 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
  2. 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
  3. 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstructioncited by 0
  4. 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modelingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Demiurge: Forging Navigable 4D Worlds via Autoregressive Video Rerendering
  2. 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution
  3. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
  4. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  5. 2025ChronosObserver: Taming 4D World with Hyperspace Diffusion Sampling
  6. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control
  7. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms
  8. 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling