FlowAct-R1: Towards Interactive Humanoid Video Generation
Not on the map. Why?
Abstract (arXiv)
Interactive humanoid video generation aims to synthesize lifelike visual agents that can engage with humans through continuous and responsive video. Despite recent advances in video synthesis, existing methods often grapple with the trade-off between high-fidelity synthesis and real-time interaction requirements. In this paper, we propose FlowAct-R1, a framework specifically designed for real-time interactive humanoid video generation. Built upon a MMDiT architecture, FlowAct-R1 enables the streaming synthesis of video with arbitrary durations while maintaining low-latency responsiveness. We introduce a chunkwise diffusion forcing strategy, complemented by a novel self-forcing variant, to alleviate error accumulation and ensure long-term temporal consistency during continuous interaction. By leveraging efficient distillation and system-level optimizations, our framework achieves a stable 25fps at 480p resolution with a time-to-first-frame (TTFF) of only around 1.5 seconds. The proposed method provides holistic and fine-grained full-body control, enabling the agent to transition naturally between diverse behavioral states in interactive scenarios. Experimental results demonstrate that FlowAct-R1 achieves exceptional behavioral vividness and perceptual realism, while maintaining robust generalization across diverse character styles.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
31 of 38 references.
References · 31
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023Consistency Modelscited by 1,822
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
19 more
- 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 250
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 98
- 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
- 2024INFP: Audio-Driven Interactive Head Generation in Dyadic Conversationscited by 40
- 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 32
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
- 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 19
- 2025MagicInfinite: Generating Infinite Talking Videos with Your Words and Voicecited by 16
- 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generationcited by 16
- 2025ARIG: Autoregressive Interactive Head Generation for Real-time Conversationscited by 16
- 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
- 2024PersonaTalk: Bring Attention to Your Persona in Visual Dubbingcited by 15
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 14
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Modelscited by 7
- 2026InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatarscited by 5
- 2026Video = World + Event Streamcited by 2
- 2026InterDyad: Interactive Dyadic Speech-to-Video Generation by Querying Intermediate Visual Guidancecited by 1
- 2026Real-Time Human-Centric World Modeling for Upper-Body Human-Object Interactioncited by 1
- 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatarscited by 0
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioningcited by 0
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adaptercited by 0
- 2026FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planningcited by 0
- 2026FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning28 Sep 2026
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter21 Aug 2026
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioning17 Aug 2026
- 2026Real-Time Human-Centric World Modeling for Upper-Body Human-Object Interaction26 Jul 2026
- 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars25 Jul 2026
- 2026Video = World + Event Stream16 Jul 2026
- 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators9 Jul 2026
- 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models23 Jun 2026
- 2026InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars22 Jun 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026InterDyad: Interactive Dyadic Speech-to-Video Generation by Querying Intermediate Visual Guidance24 Mar 2026