mlsanityData to 7 Oct 2026

EDGE: Editable Dance Generation From Music

arXiv 2211.10658 ↗First posted 19 Nov 2022cs.SD cs.CV cs.GRcited by 284

Not on the map. Why?

Cited by 83 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Dance is an important human art form, but creating new dances can be difficult and time-consuming. In this work, we introduce Editable Dance GEneration (EDGE), a state-of-the-art method for editable dance generation that is capable of creating realistic, physically-plausible dances while remaining faithful to the input music. EDGE uses a transformer-based diffusion model paired with Jukebox, a strong music feature extractor, and confers powerful editing capabilities well-suited to dance, including joint-wise conditioning, and in-betweening. We introduce a new metric for physical plausibility, and evaluate dance quality generated by our method extensively through (1) multiple quantitative metrics on physical plausibility, beat alignment, and diversity benchmarks, and more importantly, (2) a large-scale user study, demonstrating a significant improvement over previous state-of-the-art methods. Qualitative samples from our model can be found at our website.

Key facts. Cited by 284 papers in the map (data through 7 Oct 2026). Builds on 40 of its 68 references that are in the map. First posted on arXiv 19 Nov 2022.

Builds on

40 of 68 references.

References · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  9. 2014Conditional Generative Adversarial Netscited by 2,152
  10. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  11. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  12. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
28 more
  1. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  2. 2022Human Motion Diffusion Modelcited by 1,062
  3. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  4. 2019An Introduction to Variational Autoencoderscited by 997
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  6. 2020Jukebox: A Generative Model for Musiccited by 535
  7. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  8. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  9. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  10. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  11. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  12. 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
  13. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  14. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  15. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  16. 2021Character Controllers Using Motion VAEscited by 182
  17. 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 172
  18. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  19. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  20. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  21. 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 66
  22. 2021Codified audio language modeling learns useful representations for music information retrievalcited by 61
  23. 2020MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistencycited by 31
  24. 2022Real-time Controllable Motion Transition for Characterscited by 29
  25. 2021Transflower: probabilistic autoregressive dance generation with multimodal attentioncited by 22
  26. 2022Dance Style Transfer with Cross-modal Transformercited by 20
  27. 2022ChoreoGraph: Music-conditioned Automatic Dance Choreography over a Style and Tempo Consistent Dynamic Graphcited by 17
  28. 2022Music-driven Dance Regeneration with Controllable Key Pose Constraintscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 58; 2024: 80; 2025: 99; 2026: 45.

284 papers.

Sort:

By area:

  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  2. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  3. 2023Human Motion Diffusion as a Generative Priorcited by 354
  4. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  5. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  6. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  7. 2023Object Motion Guided Human Motion Synthesiscited by 206
  8. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  9. 2023MMM: Generative Masked Motion Modelcited by 129
  10. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
  11. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  12. 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 124
38 more
  1. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  2. 2023Controllable Human-Object Interaction Synthesiscited by 107
  3. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
  4. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  5. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
  6. 2023Human Motion Generation: A Surveycited by 95
  7. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  8. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
  9. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  10. 2024From Audio to Photoreal Embodiment: Synthesizing Humans in Conversationscited by 82
  11. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  12. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  13. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  14. 2023FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusioncited by 77
  15. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
  16. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
  17. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  18. 2023Single Motion Diffusioncited by 65
  19. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  20. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  21. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 59
  22. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 56
  23. 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
  24. 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Modelscited by 52
  25. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
  26. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
  27. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  28. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
  29. 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
  30. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
  31. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  32. 2024ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesiscited by 41
  33. 2023LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generationcited by 40
  34. 2025Motion Anything: Any to Motion Generationcited by 40
  35. 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
  36. 2023Iterative Motion Editing with Natural Languagecited by 39
  37. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
  38. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 37

50 most cited of 284 All 284 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023EnchantDance: Unveiling the Potential of Music-Driven Dance Movement
  2. 2026Dance to Music Generation leveraging Pre-training with Unpaired data and Contrastive Alignment ↗
  3. 2024Dance Any Beat: Blending Beats with Visuals in Dance Video Generation
  4. 2023DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation
  5. 2026PF-D2M: A Pose-free Diffusion Model for Universal Dance-to-Music Generation
  6. 2025GACA-DiT: Diffusion-based Dance-to-Music Generation with Genre-Adaptive Rhythm and Context-Aware Alignment
  7. 2023DanceMeld: Unraveling Dance Phrases with Hierarchical Latent Codes for Music-to-Dance Synthesis
  8. 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation