ReactDance: Hierarchical Representation for High-Fidelity and Coherent Long-Form Reactive Dance Generation
Not on the map. Why?
Abstract (arXiv)
Reactive dance generation (RDG), the task of generating a dance conditioned on a lead dancer's motion, holds significant promise for enhancing human-robot interaction and immersive digital entertainment. Despite progress in duet synchronization and motion-music alignment, two key challenges remain: generating fine-grained spatial interactions and ensuring long-term temporal coherence. In this work, we introduce ReactDance, a diffusion framework that operates on a novel hierarchical latent space to address these spatiotemporal challenges in RDG. First, for high-fidelity spatial expression and fine-grained control, we propose Hierarchical Finite Scalar Quantization (HFSQ). This multi-scale motion representation effectively disentangles coarse body posture from subtle limb dynamics, enabling independent and detailed control over both aspects through a layered guidance mechanism. Second, to efficiently generate long sequences with high temporal coherence, we propose Blockwise Local Context (BLC), a non-autoregressive sampling strategy. Departing from slow, frame-by-frame generation, BLC partitions the sequence into blocks and synthesizes them in parallel via periodic causal masking and positional encodings. Coherence across these blocks is ensured by a dense sliding-window training approach that enriches the representation with local temporal context. Extensive experiments show that ReactDance substantially outperforms state-of-the-art methods in motion quality, long-term coherence, and sampling efficiency. Project page: https://ripemangobox.github.io/ReactDance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 8 May 2025.
Builds on
31 of 43 references.
References · 31
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
- 2023Symbolic Discovery of Optimization Algorithmscited by 434
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2023Human Motion Diffusion as a Generative Priorcited by 357
19 more
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
- 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
- 2023HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codeccited by 97
- 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
- 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 47
- 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 44
- 2023DiffDance: Cascaded Human Motion Diffusion Model for Dance Generationcited by 23
- 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 23
- 2023Dance with You: The Diversity Controllable Dancer Generation via Diffusion Modelscited by 17
- 2025Co3Gesture: Towards Coherent Concurrent Co-speech 3D Gesture Generation with Interactive Diffusioncited by 9
- 2024Harmonious Group Choreography with Trajectory-Controllable Diffusioncited by 3
- 2018Dance Teaching by a Robot: Combining Cognitive and Physical Human-Robot Interaction for Supporting the Skill Learning Processcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023LongDanceDiff: Long-term Dance Generation with Conditional Diffusion Model
- 2026Contact Matrix: Enhancing Dance Motion Synthesis with Precise Interaction Modeling
- 2026Diffusion Path Alignment for Long-Range Motion Generation and Domain Transitions
- 2024DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction
- 2025DFM: Deep Fourier Mimic for Expressive Dance Motion Learning
- 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
- 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Dataset
- 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation