mlsanityData to 14 Oct 2026

MDD: A Dataset for Text-and-Music Conditioned Duet Dance Generation

arXiv 2508.16911 ↗First posted 23 Aug 2025cs.GR cs.CV cs.MMcited by 4

Not on the map. Why?

Abstract (arXiv)

We introduce Multimodal DuetDance (MDD), a diverse multimodal benchmark dataset designed for text-controlled and music-conditioned 3D duet dance motion generation. Our dataset comprises 620 minutes of high-quality motion capture data performed by professional dancers, synchronized with music, and detailed with over 10K fine-grained natural language descriptions. The annotations capture a rich movement vocabulary, detailing spatial relationships, body movements, and rhythm, making MDD the first dataset to seamlessly integrate human motions, music, and text for duet dance generation. We introduce two novel tasks supported by our dataset: (1) Text-to-Duet, where given music and a textual prompt, both the leader and follower dance motion are generated (2) Text-to-Dance Accompaniment, where given music, textual prompt, and the leader's motion, the follower's motion is generated in a cohesive, text-aligned manner. We include baseline evaluations on both tasks to support future research.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

33 of 51 references.

References · 33

  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2022Human Motion Diffusion Modelcited by 1,080
  3. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  4. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  5. 2020Jukebox: A Generative Model for Musiccited by 542
  6. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  7. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  8. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  9. 2022EDGE: Editable Dance Generation From Musiccited by 287
  10. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  11. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  12. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
21 more
  1. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
  2. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  3. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  4. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
  5. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  6. 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
  7. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
  8. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  9. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
  10. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  11. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  12. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  13. 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 47
  14. 2023Music-Driven Group Choreographycited by 37
  15. 2025Ready-to-React: Online Reaction Policy for Two-Character Interaction Generationcited by 28
  16. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
  17. 2024POPDG: Popular 3D Dance Generation with PopDanceSetcited by 24
  18. 2024InterDance:Reactive 3D Dance Generation with Realistic Duet Interactionscited by 22
  19. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  20. 2021GAN-based Reactive Motion Synthesis with Class-aware Discriminators for Human-human Interactioncited by 18
  21. 2024Exploring Multi-Modal Control in Music-Driven Dance Generationcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

  1. 2025Unified Multi-Modal Interactive & Reactive 3D Motion Generation via Rectified Flowcited by 6
  2. 2026Sketch2Colab: Sketch-Conditioned Multi-Human Animation via Controllable Flow Distillationcited by 1
  3. 2026Text Dictates, Music Decorates: Energy-based Attention for Editable Dance Motion Generationcited by 0
  4. 2026MIME: Multimodal Interactive Motion Encodercited by 0