mlsanityData to 14 Oct 2026

ReactDance: Hierarchical Representation for High-Fidelity and Coherent Long-Form Reactive Dance Generation

arXiv 2505.05589 ↗First posted 8 May 2025cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Reactive dance generation (RDG), the task of generating a dance conditioned on a lead dancer's motion, holds significant promise for enhancing human-robot interaction and immersive digital entertainment. Despite progress in duet synchronization and motion-music alignment, two key challenges remain: generating fine-grained spatial interactions and ensuring long-term temporal coherence. In this work, we introduce ReactDance, a diffusion framework that operates on a novel hierarchical latent space to address these spatiotemporal challenges in RDG. First, for high-fidelity spatial expression and fine-grained control, we propose Hierarchical Finite Scalar Quantization (HFSQ). This multi-scale motion representation effectively disentangles coarse body posture from subtle limb dynamics, enabling independent and detailed control over both aspects through a layered guidance mechanism. Second, to efficiently generate long sequences with high temporal coherence, we propose Blockwise Local Context (BLC), a non-autoregressive sampling strategy. Departing from slow, frame-by-frame generation, BLC partitions the sequence into blocks and synthesizes them in parallel via periodic causal masking and positional encodings. Coherence across these blocks is ensured by a dense sliding-window training approach that enriches the representation with local temporal context. Extensive experiments show that ReactDance substantially outperforms state-of-the-art methods in motion quality, long-term coherence, and sampling efficiency. Project page: https://ripemangobox.github.io/ReactDance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

31 of 43 references.

References · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2022Human Motion Diffusion Modelcited by 1,080
  6. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  7. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  8. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  9. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  10. 2023Symbolic Discovery of Optimization Algorithmscited by 434
  11. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  12. 2023Human Motion Diffusion as a Generative Priorcited by 357
19 more
  1. 2022EDGE: Editable Dance Generation From Musiccited by 287
  2. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  3. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  4. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  5. 2023HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codeccited by 97
  6. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
  7. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  8. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  9. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  10. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
  11. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  12. 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 47
  13. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 44
  14. 2023DiffDance: Cascaded Human Motion Diffusion Model for Dance Generationcited by 23
  15. 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 23
  16. 2023Dance with You: The Diversity Controllable Dancer Generation via Diffusion Modelscited by 17
  17. 2025Co3Gesture: Towards Coherent Concurrent Co-speech 3D Gesture Generation with Interactive Diffusioncited by 9
  18. 2024Harmonious Group Choreography with Trajectory-Controllable Diffusioncited by 3
  19. 2018Dance Teaching by a Robot: Combining Cognitive and Physical Human-Robot Interaction for Supporting the Skill Learning Processcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023LongDanceDiff: Long-term Dance Generation with Conditional Diffusion Model
  2. 2026Contact Matrix: Enhancing Dance Motion Synthesis with Precise Interaction Modeling
  3. 2026Diffusion Path Alignment for Long-Range Motion Generation and Domain Transitions
  4. 2024DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction
  5. 2025DFM: Deep Fourier Mimic for Expressive Dance Motion Learning
  6. 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
  7. 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Dataset
  8. 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation