Music-to-Dance Generation via Atomic Movements
Not on the map. Why?
Abstract (arXiv)
Music-driven dance generation aims to produce human motion that is both rhythmically synchronized and semantically consistent with music. While recent neural approaches have achieved impressive visual realism, they typically model motion as a continuous signal and neglect its compositional nature, making generated dances structurally incoherent and difficult to control. In this work, we introduce a structure-aware framework that models choreography as a sequence of atomic movements-semantically interpretable motion events that serve as the building blocks of dance. To construct this atomic movement vocabulary, we first segment large-scale dance data and cluster them into atomic movement groups. We then employ a large language model to semantically relabel and refine the clusters, yielding a set of interpretable and reusable atomic movements. Based on these atomic movement annotations, we design a two-stage generation framework that mirrors the human choreography process. In the atomic movement planning stage, the model predicts the type, duration, and timing of atomic movements conditioned on the input music, forming a symbolic dance allocation. In the completion stage, a transition-aware generator synthesizes smooth and stylistically coherent motion conditioned on the planned structure. Extensive experiments demonstrate that our method produces dances with significantly improved structural coherence, rhythmic alignment, and perceptual naturalness compared to existing baselines, while providing enhanced interpretability and controllable editing through explicit structural representation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
19 of 33 references.
References · 19
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
7 more
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2021Zero-shot Natural Language Video Localizationcited by 34
- 2024Beat-It: Beat-Synchronized Multi-Condition 3D Dance Generationcited by 24
- 2025Align Your Rhythm: Generating Highly Aligned Dance Poses with Gating-Enhanced Rhythm-Aware Feature Representationcited by 8
- 2025Interact-Custom: Customized Human Object Interaction Image Generationcited by 3
- 2025InteractMove: Text-Controlled Human-Object Interaction Generation in 3D Scenes with Movable Objectscited by 3
- 2022Fractal Patterns in Musiccited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.