mlsanityData to 14 Oct 2026

DanceCrafter: Fine-Grained Text-Driven Controllable Dance Generation via Choreographic Syntax

arXiv 2604.18648 ↗First posted 20 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-driven controllable dance generation remains under-explored, primarily due to the severe scarcity of high-quality datasets and the inherent difficulty of articulating complex choreographies. Characterizing dance is particularly challenging owing to its intricate spatial dynamics, strong directionality, and the highly decoupled movements of distinct body parts. To overcome these bottlenecks, we bridge principles from dance studies, human anatomy, and biomechanics to propose textitChoreographic Syntax, a novel theoretical framework with a tailored annotation system. Grounded in this syntax, we combine professional dance archives with high-fidelity motion capture data to construct DanceFlow, the most fine-grained dance dataset to date. It encompasses 41 hours of high-quality motions paired with 6.34 million words of detailed descriptions. At the model level, we introduce DanceCrafter, a tailored motion transformer built upon the Momentum Human Rig. To circumvent optimization instabilities, we construct a continuous manifold motion representation paired with a hybrid normalization strategy. Furthermore, we design an anatomy-aware loss to explicitly regulate the decoupled nature of body parts. Together, these adaptations empower DanceCrafter to achieve the high-fidelity and stable generation of complex dance sequences. Extensive evaluations and user studies demonstrate our state-of-the-art performance in motion quality, fine-grained controllability, and generation naturalness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

21 of 44 references.

References · 21

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  4. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  5. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  6. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  7. 2016The KIT Motion-Language Datasetcited by 338
  8. 2020Query-Key Normalization for Transformerscited by 280
  9. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  10. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  11. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
  12. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
9 more
  1. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
  2. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
  3. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
  4. 2025X-Dancer: Expressive Music to Human Dance Video Generationcited by 15
  5. 2024On Efficient and Statistical Quality Estimation for Data Annotationcited by 8
  6. 2025DanceEditor: Towards Iterative Editable Music-driven Dance Generation with Open-Vocabulary Descriptionscited by 6
  7. 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 6
  8. 2025Music-Aligned Holistic 3D Dance Generation via Hierarchical Motion Modelingcited by 4
  9. 2025Walk Before You Dance: High-fidelity and Editable Dance Synthesis via Generative Masked Motion Priorcited by 1

Built on by

Not cited yet.