FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation
Not on the map. Why?
Abstract (arXiv)
Generating full-body and multi-genre dance sequences from given music is a challenging task, due to the limitations of existing datasets and the inherent complexity of the fine-grained hand motion and dance genres. To address these problems, we propose FineDance, which contains 14.6 hours of music-dance paired data, with fine-grained hand motions, fine-grained genres (22 dance genres), and accurate posture. To the best of our knowledge, FineDance is the largest music-dance paired dataset with the most dance genres. Additionally, to address monotonous and unnatural hand movements existing in previous methods, we propose a full-body dance generation network, which utilizes the diverse generation capabilities of the diffusion model to solve monotonous problems, and use expert nets to solve unreal problems. To further enhance the genre-matching and long-term stability of generated dances, we propose a Genre&Coherent aware Retrieval Module. Besides, we propose a novel metric named Genre Matching Score to evaluate the genre-matching degree between dance and music. Quantitative and qualitative experiments demonstrate the quality of FineDance, and the state-of-the-art performance of FineNet. The FineDance Dataset and more qualitative samples can be found at our website.
Key facts. Cited by 88 papers in the map (data through 14 Oct 2026). Builds on 23 of its 55 references that are in the map. First posted on arXiv 7 Dec 2022.
Builds on
23 of 55 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Generative Adversarial Networkscited by 5,627
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021AST: Audio Spectrogram Transformercited by 643
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
11 more
- 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
- 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
- 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2020Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audiocited by 33
- 2020ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unitcited by 31
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
Built on by
Citing papers per year: 2023: 8; 2024: 22; 2025: 34; 2026: 24.
88 papers.
Sort:
By area:
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 38
38 more
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2024Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Modelcited by 35
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 26
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
- 2023Chain of Generation: Multi-Modal Gesture Synthesis via Cascaded Conditional Controlcited by 18
- 2023Realistic Human Motion Generation with Cross-Diffusion Modelscited by 17
- 2025X-Dancer: Expressive Music to Human Dance Video Generationcited by 15
- 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotationscited by 14
- 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
- 2024Bidirectional Autoregressive Diffusion Model for Dance Generationcited by 13
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
- 2025MOSPA: Human Motion Generation Driven by Spatial Audiocited by 12
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2025FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generationcited by 11
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
- 2024Exploring Multi-Modal Control in Music-Driven Dance Generationcited by 10
- 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generationcited by 9
- 2024DanceCamera3D: 3D Camera Movement Synthesis with Music and Dancecited by 8
- 2025Align Your Rhythm: Generating Highly Aligned Dance Poses with Gating-Enhanced Rhythm-Aware Feature Representationcited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 2024SEE-DPO: Self Entropy Enhanced Direct Preference Optimizationcited by 7
- 2024AToM: Aligning Text-to-Motion Model at Event-Level with GPT-4Vision Rewardcited by 7
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakerscited by 7
- 2024Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attributecited by 6
- 2025DanceEditor: Towards Iterative Editable Music-driven Dance Generation with Open-Vocabulary Descriptionscited by 6
- 2025ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Bodycited by 6
- 2024Lagrangian Motion Fields for Long-term Motion Generationcited by 5
- 2024A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motionscited by 5
- 2025DanceChat: Large Language Model-Guided Music-to-Dance Generationcited by 5
- 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robotscited by 5
- 2024Scalable Group Choreography via Variational Phase Manifold Learningcited by 4
- 2025Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesiscited by 4
- 2025InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animationcited by 4
- 2025TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreographycited by 4
- 2025PP-Motion: Physical-Perceptual Fidelity Evaluation for Human Motion Generationcited by 4
- 2025MDD: A Dataset for Text-and-Music Conditioned Duet Dance Generationcited by 4
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generationcited by 4
50 most cited of 88 All 88 (JSON)
- 2026LatticeSMC: Where to Spend Inference-Time Compute in Chunked Sequence Generators2 Oct 2026
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioning17 Aug 2026
- 2026FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams16 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation10 Jul 2026
- 2026OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data29 Jun 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
- 2026Text Dictates, Music Decorates: Energy-based Attention for Editable Dance Motion Generation22 Jun 2026
- 2026Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion19 Jun 2026
- 2026SalsaAgent: A multimodal embodied language model for interactive dance generation28 May 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers7 May 2026
38 more
- 2026Seeing Without Eyes: 4D Human-Scene Understanding from Wearable IMUs23 Apr 2026
- 2026TeMuDance: Contrastive Alignment-Based Textual Control for Music-Driven Dance Generation18 Apr 2026
- 2026PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual Coordination14 Apr 2026
- 2026BiTDiff: Fine-Grained 3D Conducting Motion Generation via BiMamba-Transformer Diffusion6 Apr 2026
- 2026Not All Frames Are Equal: Complexity-Aware Masked Motion Generation via Motion Spectral Descriptors31 Mar 2026
- 2026TokenDance: Token-to-Token Music-to-Dance Generation with Bidirectional Mamba28 Mar 2026
- 2026ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography20 Mar 2026
- 2026InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization10 Mar 2026
- 2026Not Like Transformers: Drop the Beat Representation for Dance Generation with Mamba-Based Diffusion Model9 Mar 2026
- 2026Skeleton2Stage: Reward-Guided Fine-Tuning for Physically Plausible Dance Generation14 Feb 2026
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens12 Feb 2026
- 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Dataset6 Jan 2026
- 2025UniAct: Unified Motion Generation and Action Streaming for Humanoid Robots30 Dec 2025
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec 2025
- 2025Tempo as the Stable Cue: Hierarchical Mixture of Tempo and Beat Experts for Music to 3D Dance Generation21 Dec 2025
- 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation20 Dec 2025
- 2025ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body16 Dec 2025
- 2025Reframing Music-Driven 2D Dance Pose Generation as Multi-Channel Image Generation12 Dec 2025
- 2025FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation26 Nov 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation22 Oct 2025
- 2025OmniMotion: Multimodal Motion Generation with Continuous Masked Autoregression16 Oct 2025
- 2025DanceEditor: Towards Iterative Editable Music-driven Dance Generation with Open-Vocabulary Descriptions24 Aug 2025
- 2025MDD: A Dataset for Text-and-Music Conditioned Duet Dance Generation23 Aug 2025
- 2025PP-Motion: Physical-Perceptual Fidelity Evaluation for Human Motion Generation11 Aug 2025
- 2025ST-GDance: Long-Term and Collision-Free Group Choreography from Music29 Jul 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025MOSPA: Human Motion Generation Driven by Spatial Audio16 Jul 2025
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data9 Jul 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025PrefPaint: Enhancing Medical Image Inpainting through Expert Human Feedback27 Jun 2025
- 2025TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography23 Jun 2025
- 2025DanceChat: Large Language Model-Guided Music-to-Dance Generation12 Jun 2025
- 2025OpenDance: Multimodal Controllable 3D Dance Generation with Large-scale Internet Data9 Jun 2025
- 2025MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generation3 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2025ReactDance: Hierarchical Representation for High-Fidelity and Coherent Long-Form Reactive Dance Generation8 May 2025
- 2025InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation15 Apr 2025
50 newest of 88 All 88 (JSON)
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2024Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Modelcited by 35
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2023Realistic Human Motion Generation with Cross-Diffusion Modelscited by 17
- 2024Bidirectional Autoregressive Diffusion Model for Dance Generationcited by 13
- 2024SEE-DPO: Self Entropy Enhanced Direct Preference Optimizationcited by 7
- 2025Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesiscited by 4
- 2025InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animationcited by 4
- 2025TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreographycited by 4
12 most cited of 17 All 17 (JSON)
- 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation10 Jul 2026
- 2026Not Like Transformers: Drop the Beat Representation for Dance Generation with Mamba-Based Diffusion Model9 Mar 2026
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation22 Oct 2025
- 2025TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography23 Jun 2025
- 2025MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generation3 Jun 2025
- 2025InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation15 Apr 2025
- 2025Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesis14 Apr 2025
- 2024DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction7 Nov 2024
- 2024SEE-DPO: Self Entropy Enhanced Direct Preference Optimization6 Nov 2024
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr 2024
12 newest of 17 All 17 (JSON)
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 38
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 26
- 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
- 2023Chain of Generation: Multi-Modal Gesture Synthesis via Cascaded Conditional Controlcited by 18
12 most cited of 68 All 68 (JSON)
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioning17 Aug 2026
- 2026FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams16 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data29 Jun 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
- 2026Text Dictates, Music Decorates: Energy-based Attention for Editable Dance Motion Generation22 Jun 2026
- 2026Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion19 Jun 2026
- 2026SalsaAgent: A multimodal embodied language model for interactive dance generation28 May 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers7 May 2026
- 2026Seeing Without Eyes: 4D Human-Scene Understanding from Wearable IMUs23 Apr 2026
- 2026TeMuDance: Contrastive Alignment-Based Textual Control for Music-Driven Dance Generation18 Apr 2026
12 newest of 68 All 68 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023EnchantDance: Unveiling the Potential of Music-Driven Dance Movement
- 2025MEGADance: Mixture-of-Experts Architecture for Genre-Aware 3D Dance Generation
- 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
- 2023DanceMeld: Unraveling Dance Phrases with Hierarchical Latent Codes for Music-to-Dance Synthesis
- 2026Dance to Music Generation leveraging Pre-training with Unpaired data and Contrastive Alignment ↗
- 2026PF-D2M: A Pose-free Diffusion Model for Universal Dance-to-Music Generation
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integration
- 2024LM2D: Lyrics- and Music-Driven Dance Synthesis