Video = World + Event Stream
Not on the map. Why?
Abstract (arXiv)
We present Wan-Streamer v0.3, which reframes our native-streaming interaction model under a single organizing view: a video is a world plus an event stream. The world is the persistent context in which a video unfolds, including the environment, scene, subjects, ambient acoustic conditions, voice characteristics, and other relatively stable conditions. The event stream is everything that changes over time within that world, including scene or environmental changes, subject behavior, speech, and other sounds. This yields a general-purpose pretraining task over large amounts of real video: given a world and incoming input, predict how the world moves, changes, and responds in real time. The resulting competence can be specialized to a broad family of real-time downstream tasks. We instantiate it on real-time full-duplex audio-visual interaction, where the event stream is the agent's speech together with free-form behavior. Functionally, the model's multimodal understanding process is vision-language-action-like: it maps multimodal user input to language-form speech and behavior actions. Wan-Streamer v0.3 preserves the v0.2 operating point: 640x368 video at 25 FPS, a 160 ms streaming unit, approximately 200 ms model-side response latency, and approximately 550 ms total interaction latency under a 350 ms bidirectional network budget.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
11 of 15 references.
References · 11
- 2026Causal World Modeling for Robot Controlcited by 289
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
- 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
- 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillationcited by 13
- 2026FlowAct-R1: Towards Interactive Humanoid Video Generationcited by 11
- 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Modelscited by 7
- 2026Wan-Streamer v0.2: Higher Resolution, Same Latencycited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025X-Streamer: Unified Human World Modeling with Audiovisual Interaction
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
- 2026Harnessing Streaming Video in the Wild
- 2026OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
- 2026RIVER: A Real-Time Interaction Benchmark for Video LLMs
- 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarios
- 2026Speak While Watching: Unleashing TRUE Real-Time Video Understanding Capability of Multimodal Large Language Models
- 2026Event-VStream: Event-Driven Real-Time Understanding for Long Video Streams