mlsanityData to 7 Oct 2026

EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation

arXiv 2312.02256 ↗First posted 4 Dec 2023cs.CV cs.AI cs.GRcited by 88

On the map: Diffusion models → Video generation

Abstract (arXiv)

We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without sacrificing quality. On the one hand, previous works, like motion latent diffusion, conduct diffusion within a latent space for efficiency, but learning such a latent space can be a non-trivial effort. On the other hand, accelerating generation by naively increasing the sampling step size, e.g., DDIM, often leads to quality degradation as it fails to approximate the complex denoising distribution. To address these issues, we propose EMDM, which captures the complex distribution during multiple sampling steps in the diffusion model, allowing for much fewer sampling steps and significant acceleration in generation. This is achieved by a conditional denoising diffusion GAN to capture multimodal data distributions among arbitrary (and potentially larger) step sizes conditioned on control signals, enabling fewer-step motion sampling with high fidelity and diversity. To minimize undesired motion artifacts, geometric losses are imposed during network learning. As a result, EMDM achieves real-time motion generation and significantly improves the efficiency of motion diffusion models compared to existing methods while achieving high-quality motion generation. Our code will be publicly available upon publication.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 80 of its 103 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

80 of 103 references.

Closest ancestors · 12

Same direction, newest first

  1. 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model2 Dec
  2. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct
  3. 2023Priority-Centric Human Motion Generation in Discrete Latent Space28 Aug
  4. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun
  5. 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
  6. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  7. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  8. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
  10. 2022Human Motion Diffusion Model29 Sep
  11. 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep
  12. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 68

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  12. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
38 more
  1. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  2. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  3. 2018Which Training Methods for GANs do actually Converge?cited by 672
  4. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  5. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  6. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  7. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  8. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  9. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  10. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  11. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  12. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  13. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  14. 2016The KIT Motion-Language Datasetcited by 334
  15. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  16. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
  17. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  18. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  19. 2021Robust Motion In-betweeningcited by 223
  20. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  21. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  22. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
  23. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
  24. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  25. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  26. 2023Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generationcited by 128
  27. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  28. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  29. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  30. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 93
  31. 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
  32. 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
  33. 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 74
  34. 2022Implicit Neural Representations for Variable Length Human Motion Generationcited by 61
  35. 2021Single-Shot Motion Completion with Transformercited by 59
  36. 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
  37. 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 53
  38. 2022MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labelscited by 45

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 29; 2025: 40; 2026: 18.

88 papers.

Sort:

By area:

  1. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  2. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
  3. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  4. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  5. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  6. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  7. 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
  8. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  9. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
  10. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  11. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
  12. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
38 more
  1. 2025Motion Anything: Any to Motion Generationcited by 40
  2. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
  3. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  4. 2025Efficient Diffusion Models: A Surveycited by 35
  5. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  6. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  7. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 26
  8. 2024PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarioscited by 24
  9. 2024InterDance:Reactive 3D Dance Generation with Realistic Duet Interactionscited by 22
  10. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 19
  11. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
  12. 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
  13. 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 16
  14. 2025HERO: Human Reaction Generation from Videoscited by 15
  15. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  16. 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
  17. 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
  18. 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
  19. 2024SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generationcited by 12
  20. 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarioscited by 11
  21. 2025MOSPA: Human Motion Generation Driven by Spatial Audiocited by 11
  22. 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 10
  23. 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 10
  24. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  25. 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
  26. 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
  27. 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
  28. 2024Move-in-2D: 2D-Conditioned Human Motion Generationcited by 8
  29. 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
  30. 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
  31. 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
  32. 2025ModSkill: Physical Character Skill Modularizationcited by 7
  33. 2025EgoReAct: Egocentric Video-Driven 3D Human Reaction Generationcited by 7
  34. 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
  35. 2025Zero-Shot Trajectory Planning for Signal Temporal Logic Taskscited by 6
  36. 20253D Human Interaction Generation: A Surveycited by 6
  37. 2025DIMO: Diverse 3D Motion Generation for Arbitrary Objectscited by 6
  38. 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Modelscited by 6

50 most cited of 88 All 88 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022VIDM: Video Implicit Diffusion Models
  2. 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3
  3. 2025Unconditional Human Motion and Shape Generation via Balanced Score-Based Diffusion
  4. 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Training
  5. 2022Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
  6. 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
  7. 2023Video Probabilistic Diffusion Models in Projected Latent Space
  8. 2025Back to Basics: Motion Representation Matters for Human Motion Generation Using Diffusion Model