FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generation
Not on the map. Why?
Abstract (arXiv)
We present FloodDiffusion, a new framework for text-driven, streaming human motion generation. Given time-varying text prompts, FloodDiffusion generates text-aligned, seamless motion sequences with real-time latency. Unlike existing methods that rely on chunk-by-chunk or auto-regressive model with diffusion head, we adopt a diffusion forcing framework to model this time-series generation task under time-varying control events. We find that a straightforward implementation of vanilla diffusion forcing (as proposed for video models) fails to model real motion distributions. We demonstrate that to guarantee modeling the output distribution, the vanilla diffusion forcing must be tailored to: (i) train with a bi-directional attention instead of casual attention; (ii) implement a lower triangular time scheduler instead of a random one; (iii) utilize a continues time-varying way to introduce text conditioning. With these improvements, we demonstrate in the first time that the diffusion forcing-based framework achieves state-of-the-art performance on the streaming motion generation task, reaching an FID of 0.057 on the HumanML3D benchmark. Models, code, and weights are available. https://shandaai.github.io/FloodDiffusion/
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 37 of its 43 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
37 of 43 references.
References · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017Neural Discrete Representation Learningcited by 4,650
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
25 more
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
- 2024Progressive Autoregressive Video Diffusion Modelscited by 65
- 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generationcited by 56
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 53
- 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Modelcited by 41
- 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
- 2023Video Diffusion Models with Local-Global Context Guidancecited by 15
- 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 13
- 2024Text-driven Human Motion Generation with Motion Masked Diffusion Modelcited by 8
- 2025Video Motion Graphscited by 5
- 2025Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesiscited by 2
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakerscited by 7
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 4
- 2026ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interactioncited by 2
- 2026Refining Compositional Diffusion for Reliable Long-Horizon Planningcited by 2
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generationcited by 1
- 2026ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreographycited by 0
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcingcited by 0
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyondcited by 0
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusioncited by 0
- 2026FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generationcited by 0
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Spacecited by 0
2 more
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories1 Oct 2026
- 2026Triangular Resampling for Long-Horizon Motion Generation28 Sep 2026
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space28 Sep 2026
- 2026FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation27 Sep 2026
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion25 Sep 2026
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond4 Sep 2026
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation11 Jul 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers7 May 2026
- 2026Refining Compositional Diffusion for Reliable Long-Horizon Planning4 May 2026
- 2026ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography20 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakerscited by 7
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 4
- 2026Refining Compositional Diffusion for Reliable Long-Horizon Planningcited by 2
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generationcited by 1
- 2026ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreographycited by 0
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcingcited by 0
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyondcited by 0
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusioncited by 0
- 2026FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generationcited by 0
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectoriescited by 0
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories1 Oct 2026
- 2026FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation27 Sep 2026
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion25 Sep 2026
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond4 Sep 2026
- 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation11 Jul 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers7 May 2026
- 2026Refining Compositional Diffusion for Reliable Long-Horizon Planning4 May 2026
- 2026ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography20 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026