mlsanityData to 7 Oct 2026

Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives

arXiv 2403.10518 ↗First posted 15 Mar 2024cs.CV cs.GR cs.SDcited by 59

Not on the map. Why?

Abstract (arXiv)

We propose Lodge, a network capable of generating extremely long dance sequences conditioned on given music. We design Lodge as a two-stage coarse to fine diffusion architecture, and propose the characteristic dance primitives that possess significant expressiveness as intermediate representations between two diffusion models. The first stage is global diffusion, which focuses on comprehending the coarse-level music-dance correlation and production characteristic dance primitives. In contrast, the second-stage is the local diffusion, which parallelly generates detailed motion sequences under the guidance of the dance primitives and choreographic rules. In addition, we propose a Foot Refine Block to optimize the contact between the feet and the ground, enhancing the physical realism of the motion. Our approach can parallelly generate dance sequences of extremely long length, striking a balance between global choreographic patterns and local motion quality and expressiveness. Extensive experiments validate the efficacy of our method.

Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 42 of its 68 references that are in the map. First posted on arXiv 15 Mar 2024.

Builds on

42 of 68 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  9. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  10. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  11. 2022Human Motion Diffusion Modelcited by 1,062
  12. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
30 more
  1. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  2. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  3. 2022EDGE: Editable Dance Generation From Musiccited by 284
  4. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 246
  5. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
  6. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  7. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  8. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  9. 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 172
  10. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
  11. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  12. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
  13. 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
  14. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
  15. 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 89
  16. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  17. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  18. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  19. 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
  20. 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
  21. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  22. 2021The Wanderings of Odysseus in 3D Scenescited by 59
  23. 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
  24. 2021Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Camerascited by 32
  25. 2023Chain of Generation: Multi-Modal Gesture Synthesis via Cascaded Conditional Controlcited by 18
  26. 2023LongDanceDiff: Long-term Dance Generation with Conditional Diffusion Modelcited by 12
  27. 2023GTN-Bailando: Genre Consistent Long-Term 3D Dance Generation based on Pre-trained Genre Token Networkcited by 10
  28. 2023General Debiasing for Multimodal Sentiment Analysiscited by 10
  29. 2024Exploring Multi-Modal Control in Music-Driven Dance Generationcited by 10
  30. 2022Entity-Graph Enhanced Cross-Modal Pretraining for Instance-level Product Retrievalcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 31; 2026: 19.

59 papers.

Sort:

By area:

  1. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  2. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  3. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  4. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
  5. 2025Motion Anything: Any to Motion Generationcited by 40
  6. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
  7. 2024InterDance:Reactive 3D Dance Generation with Realistic Duet Interactionscited by 22
  8. 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
  9. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  10. 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decodingcited by 17
  11. 2025X-Dancer: Expressive Music to Human Dance Video Generationcited by 15
  12. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
38 more
  1. 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
  2. 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 13
  3. 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
  4. 2025MOSPA: Human Motion Generation Driven by Spatial Audiocited by 11
  5. 2025FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generationcited by 10
  6. 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generationcited by 9
  7. 2025Align Your Rhythm: Generating Highly Aligned Dance Poses with Gating-Enhanced Rhythm-Aware Feature Representationcited by 8
  8. 2024AToM: Aligning Text-to-Motion Model at Event-Level with GPT-4Vision Rewardcited by 7
  9. 2026PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakerscited by 7
  10. 2025DanceEditor: Towards Iterative Editable Music-driven Dance Generation with Open-Vocabulary Descriptionscited by 6
  11. 2024Lagrangian Motion Fields for Long-term Motion Generationcited by 5
  12. 2026Temporal Consistency-Aware Text-to-Motion Generationcited by 5
  13. 2024A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motionscited by 4
  14. 2025Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesiscited by 4
  15. 2025InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animationcited by 4
  16. 2025TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreographycited by 4
  17. 2025PAMD: Plausibility-Aware Motion Diffusion Model for Long Dance Generationcited by 3
  18. 2025X-MoGen: Unified Motion Generation across Humans and Animalscited by 3
  19. 2026TokenDance: Token-to-Token Music-to-Dance Generation with Bidirectional Mambacited by 3
  20. 2025FLAP: Fully-controllable Audio-driven Portrait Video Generation through 3D head conditioned diffusion modelcited by 2
  21. 2025ExGes: Expressive Human Motion Retrieval and Modulation for Audio-Driven Gesture Synthesiscited by 2
  22. 2025Learning Human Motion with Temporally Conditional Mambacited by 2
  23. 2025Tempo as the Stable Cue: Hierarchical Mixture of Tempo and Beat Experts for Music to 3D Dance Generationcited by 2
  24. 2026BiTDiff: Fine-Grained 3D Conducting Motion Generation via BiMamba-Transformer Diffusioncited by 2
  25. 2025GCDance: Genre-Controlled Music-Driven 3D Full Body Dance Generationcited by 1
  26. 2025Walk Before You Dance: High-fidelity and Editable Dance Synthesis via Generative Masked Motion Priorcited by 1
  27. 2025ReactDance: Hierarchical Representation for High-Fidelity and Coherent Long-Form Reactive Dance Generationcited by 1
  28. 2025MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generationcited by 1
  29. 2025ST-GDance: Long-Term and Collision-Free Group Choreography from Musiccited by 1
  30. 2026InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalizationcited by 1
  31. 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoisingcited by 1
  32. 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generationcited by 1
  33. 2026Music-to-Dance Generation via Atomic Movementscited by 1
  34. 2025Global Position Aware Group Choreography using Large Language Modelcited by 0
  35. 2025OpenDance: Multimodal Controllable 3D Dance Generation with Large-scale Internet Datacited by 0
  36. 2025Reframing Music-Driven 2D Dance Pose Generation as Multi-Channel Image Generationcited by 0
  37. 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Datasetcited by 0
  38. 2026Skeleton2Stage: Reward-Guided Fine-Tuning for Physically Plausible Dance Generationcited by 0

50 most cited of 59 All 59 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Bidirectional Autoregressive Diffusion Model for Dance Generation
  2. 2023EnchantDance: Unveiling the Potential of Music-Driven Dance Movement
  3. 2025Enhancing Dance-to-Music Generation via Negative Conditioning Latent Diffusion Model
  4. 2023DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation
  5. 2025MEGADance: Mixture-of-Experts Architecture for Genre-Aware 3D Dance Generation
  6. 2023Controllable Group Choreography using Contrastive Diffusion
  7. 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
  8. 2024DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction