mlsanityData to 14 Oct 2026

FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams

arXiv 2608.15818 ↗First posted 16 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Music-driven dance video synthesis aims to animate a reference person according to a given music clip. The task is challenging because it requires a model to jointly learn music-to-motion correspondence, identity-preserving human animation, temporal coherence, and visually realistic video generation. We present FlowDance, a music-driven dance video generation framework that integrates explicit motion modeling with reference-preserving visual synthesis through parallel pose and RGB streams. We further introduce timestep-aware pose injection to adapt structural guidance across denoising steps and persistent identity injection to preserve the reference appearance over long video. To support this task, we further build a popularity-curated, high-resolution in-the-wild dance video dataset with synchronized music, RGB videos, 3D body motion, camera parameters, and projected 2D pose annotations. Extensive experiments show that FlowDance achieves strong performance in both dance motion generation and music-driven dance video synthesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

31 of 41 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  5. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  6. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  7. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  8. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
  9. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  10. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  11. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  12. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
19 more
  1. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  2. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
  3. 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 61
  4. 2024On the Content Bias in Fr'echet Video Distancecited by 52
  5. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  6. 2019Dance Dance Generation: Motion Transfer for Internet Videoscited by 28
  7. 2024POPDG: Popular 3D Dance Generation with PopDanceSetcited by 24
  8. 2023DiffDance: Cascaded Human Motion Diffusion Model for Dance Generationcited by 23
  9. 2025MEGADance: Mixture-of-Experts Architecture for Genre-Aware 3D Dance Generationcited by 18
  10. 2024Dance Any Beat: Blending Beats with Visuals in Dance Video Generationcited by 14
  11. 2023Dancing Avatar: Pose and Text-Guided Human Motion Videos Synthesis with Image Diffusion Modelcited by 13
  12. 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
  13. 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
  14. 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generationcited by 9
  15. 2023Explore 3D Dance Generation via Reward Model from Automatically-Ranked Demonstrationscited by 8
  16. 2025SAM-Body4D: Training-Free 4D Human Body Mesh Recovery from Videoscited by 8
  17. 2025DanceEditor: Towards Iterative Editable Music-driven Dance Generation with Open-Vocabulary Descriptionscited by 6
  18. 2025Every Image Listens, Every Image Dances: Music-Driven Image Animationcited by 4
  19. 2024MIDGET: Music Conditioned 3D Dance Generationcited by 1

Built on by

Not cited yet.