mlsanityData to 14 Oct 2026

FlowAct-R1: Towards Interactive Humanoid Video Generation

arXiv 2601.10103 ↗First posted 15 Jan 2026cs.CV cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Interactive humanoid video generation aims to synthesize lifelike visual agents that can engage with humans through continuous and responsive video. Despite recent advances in video synthesis, existing methods often grapple with the trade-off between high-fidelity synthesis and real-time interaction requirements. In this paper, we propose FlowAct-R1, a framework specifically designed for real-time interactive humanoid video generation. Built upon a MMDiT architecture, FlowAct-R1 enables the streaming synthesis of video with arbitrary durations while maintaining low-latency responsiveness. We introduce a chunkwise diffusion forcing strategy, complemented by a novel self-forcing variant, to alleviate error accumulation and ensure long-term temporal consistency during continuous interaction. By leveraging efficient distillation and system-level optimizations, our framework achieves a stable 25fps at 480p resolution with a time-to-first-frame (TTFF) of only around 1.5 seconds. The proposed method provides holistic and fine-grained full-body control, enabling the agent to transition naturally between diverse behavioral states in interactive scenarios. Experimental results demonstrate that FlowAct-R1 achieves exceptional behavioral vividness and perceptual realism, while maintaining robust generalization across diverse character styles.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

31 of 38 references.

References · 31

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2023Consistency Modelscited by 1,822
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  5. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  6. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  7. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  8. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  9. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  10. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  11. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  12. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
19 more
  1. 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 250
  2. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
  3. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
  4. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  5. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  6. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 98
  7. 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
  8. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
  9. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
  10. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
  11. 2024INFP: Audio-Driven Interactive Head Generation in Dyadic Conversationscited by 40
  12. 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 32
  13. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Modelscited by 26
  14. 2025MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generationcited by 19
  15. 2025MagicInfinite: Generating Infinite Talking Videos with Your Words and Voicecited by 16
  16. 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generationcited by 16
  17. 2025ARIG: Autoregressive Interactive Head Generation for Real-time Conversationscited by 16
  18. 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
  19. 2024PersonaTalk: Bring Attention to Your Persona in Visual Dubbingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.