TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models aim to endow AI systems with the ability to represent, generate, and interact with dynamic environments in a coherent and temporally consistent manner. While recent video generation models have demonstrated impressive visual quality, they remain limited in real-time interaction, long-horizon consistency, and persistent memory of dynamic scenes, hindering their evolution into practical world models. In this report, we present TeleWorld, a real-time multimodal 4D world modeling framework that unifies video generation, dynamic scene reconstruction, and long-term world memory within a closed-loop system. TeleWorld introduces a novel generation-reconstruction-guidance paradigm, where generated video streams are continuously reconstructed into a dynamic 4D spatio-temporal representation, which in turn guides subsequent generation to maintain spatial, temporal, and physical consistency. To support long-horizon generation with low latency, we employ an autoregressive diffusion-based video model enhanced with Macro-from-Micro Planning (MMPL)--a hierarchical planning method that reduces error accumulation from frame-level to segment-level-alongside efficient Distribution Matching Distillation (DMD), enabling real-time synthesis under practical computational budgets. Our approach achieves seamless integration of dynamic object modeling and static scene representation within a unified 4D framework, advancing world models toward practical, interactive, and computationally accessible systems. Extensive experiments demonstrate that TeleWorld achieves strong performance in both static and dynamic world understanding, long-term consistency, and real-time generation efficiency, positioning it as a practical step toward interactive, memory-enabled world models for multimodal generation and embodied intelligence.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 34 of its 44 references that are in the map. First posted on arXiv 31 Dec 2025.
Builds on
34 of 44 references.
Closest ancestors · 5
Same direction, newest first
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
Other references · 29
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
17 more
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023WonderJourney: Going from Anywhere to Everywherecited by 158
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 77
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 24
- 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
- 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Controlcited by 19
- 20254D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimationcited by 10
- 2025OccTENS: 3D Occupancy World Model via Temporal Next-Scale Predictioncited by 9
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
- 2026Geometry-Aware Implicit Memory for Video World Modelscited by 13
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interactioncited by 4
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 3
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusioncited by 2
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
4 more
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstructioncited by 0
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modelingcited by 0
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling13 Oct 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction1 Sep 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation2 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling12 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026Geometry-Aware Implicit Memory for Video World Models1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video25 May 2026
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction19 May 2026
4 more
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation8 May 2026
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion3 Mar 2026
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation5 Feb 2026
- 2026Geometry-Aware Implicit Memory for Video World Modelscited by 13
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 3
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusioncited by 2
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstructioncited by 0
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modelingcited by 0
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling13 Oct 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction1 Sep 2026
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation2 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026Geometry-Aware Implicit Memory for Video World Models1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation8 May 2026
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion3 Mar 2026
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling12 Jun 2026
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video25 May 2026
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Demiurge: Forging Navigable 4D Worlds via Autoregressive Video Rerendering
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2025ChronosObserver: Taming 4D World with Hyperspace Diffusion Sampling
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms
- 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling