mlsanityData to 7 Oct 2026

Wan-Streamer v0.2: Higher Resolution, Same Latency

arXiv 2607.04443 ↗First posted 5 Jul 2026cs.CV cs.AI cs.GRcited by 2

Not on the map. Why?

Abstract (arXiv)

We present Wan-Streamer v0.2, a latency-preserving upgrade of the native-streaming, end-to-end audio-visual interaction model. v0.2 keeps the v0.1 modeling formulation, but raises the interactive output stream from 192x336 to 640x368 while preserving approximately 200 ms model-side signal-to-signal latency at 25 FPS. The higher-resolution stream supports scene-grounded mid-shot agents whose posture, gaze, hands, nearby objects, and local scene layout remain legible during real-time conversation. To support the larger visual stream without adding user-visible delay, v0.2 keeps the thinker as a single-GPU low-latency path for streaming perception, the short language/state Transformer pass that builds the generation cache, and final decoding. The performer becomes a multi-GPU Ulysses-style context-parallel group for the expensive next-unit latent generation. Each performer rank writes incoming K/V into a pre-sharded local cache. The long high-resolution latent video sequence is split across ranks for denoising and gathered through Ulysses communication, while the much shorter audio latent sequence is generated without sequence sharding. In this split, the thinker's language/state computation reaches the performer only as K/V conditioning, so no separate language sequence has to be communicated inside the performer group. This concentrates additional hardware on visual generation while preserving the compact thinker-performer boundary, keeping total remote interaction latency at approximately 550 ms when a 350 ms bidirectional network budget is included.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 17 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

14 of 17 references.

References · 14

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  4. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  5. 2025Qwen3-Omni Technical Reportcited by 451
  6. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  7. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  8. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
  9. 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
  10. 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
  11. 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillationcited by 13
  12. 2025From Turn-Taking to Synchronous Dialogue: A Survey of Full-Duplex Spoken Language Modelscited by 9
2 more
  1. 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Modelscited by 7
  2. 2025MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.