mlsanityData to 7 Oct 2026

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

arXiv 2606.25041 ↗First posted 23 Jun 2026cs.CV cs.AI cs.GRcited by 7

Not on the map. Why?

Abstract (arXiv)

We present Wan-Streamer, a native-streaming, end-to-end interactive foundation model designed from the ground up for real-time, low-latency, full-duplex audio-visual interaction. Wan-Streamer seamlessly models language, audio, and video as both input and output within a single Transformer, where the sequence is represented as interleaved visual, audio, and text input tokens together with visual, audio, and text output tokens, coordinated by block-causal attention for incremental streaming. Unlike cascaded interactive systems that rely on separate VAD, ASR, language, TTS, audio-driven animation, or video-generation modules, Wan-Streamer does not rely on external language, speech, avatar, or video-generation modules: perception, reasoning, generation, response timing, turn management, and cross-modal synchronization are learned jointly within one unified model, reducing pipeline latency and error accumulation. To support natural audio-visual responsiveness, we redesign the entire stack around streamability, including causal encoders, causal decoders, block-causal attention, and low-latency multimodal token scheduling, enabling streaming units as short as 160 ms at 25 fps. Wan-Streamer achieves approximately 200 ms model-side response latency and approximately 550 ms total interaction latency when combined with 350 ms bidirectional network latency, supporting sub-second duplex audio-visual communication. These results position Wan-Streamer as a unified, end-to-end, multimodal interactive foundation model for low-latency streaming interaction.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 43 of its 49 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

43 of 49 references.

References · 43

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  7. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  8. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  9. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  10. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  11. 2025Qwen3-Omni Technical Reportcited by 451
  12. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
31 more
  1. 2025Kimi-VL Technical Reportcited by 381
  2. 2026Causal World Modeling for Robot Controlcited by 289
  3. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  4. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
  5. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  6. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
  7. 2026Qwen3.5-Omni Technical Reportcited by 146
  8. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
  9. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  10. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
  11. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
  12. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  13. 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 32
  14. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
  15. 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
  16. 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 20
  17. 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 18
  18. 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversationcited by 17
  19. 2025X-Streamer: Unified Human World Modeling with Audiovisual Interactioncited by 16
  20. 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
  21. 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillationcited by 13
  22. 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 12
  23. 2026FlowAct-R1: Towards Interactive Humanoid Video Generationcited by 11
  24. 2026LPM 1.0: Video-based Character Performance Modelcited by 11
  25. 2025From Turn-Taking to Synchronous Dialogue: A Survey of Full-Duplex Spoken Language Modelscited by 9
  26. 2025Towards Interactive Intelligence for Digital Humanscited by 8
  27. 2025LiveTalk: Real-Time Multimodal Interactive Video Diffusion via Improved On-Policy Distillationcited by 8
  28. 2026DuplexSLA: A Full-Duplex Spoken Language Model with Synchronized Speech, Language, and Actioncited by 8
  29. 2026AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoisingcited by 6
  30. 2025MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generationcited by 4
  31. 2026U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.