EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without sacrificing quality. On the one hand, previous works, like motion latent diffusion, conduct diffusion within a latent space for efficiency, but learning such a latent space can be a non-trivial effort. On the other hand, accelerating generation by naively increasing the sampling step size, e.g., DDIM, often leads to quality degradation as it fails to approximate the complex denoising distribution. To address these issues, we propose EMDM, which captures the complex distribution during multiple sampling steps in the diffusion model, allowing for much fewer sampling steps and significant acceleration in generation. This is achieved by a conditional denoising diffusion GAN to capture multimodal data distributions among arbitrary (and potentially larger) step sizes conditioned on control signals, enabling fewer-step motion sampling with high fidelity and diversity. To minimize undesired motion artifacts, geometric losses are imposed during network learning. As a result, EMDM achieves real-time motion generation and significantly improves the efficiency of motion diffusion models compared to existing methods while achieving high-quality motion generation. Our code will be publicly available upon publication.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 80 of its 103 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
80 of 103 references.
Closest ancestors · 12
Same direction, newest first
- 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model2 Dec
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space28 Aug
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
- 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
- 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
- 2022Human Motion Diffusion Model29 Sep
- 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug
Other references · 68
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
38 more
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2016The KIT Motion-Language Datasetcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2021Robust Motion In-betweeningcited by 223
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
- 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
- 2023Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generationcited by 128
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
- 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
- 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 93
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
- 2022ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generationcited by 77
- 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 74
- 2022Implicit Neural Representations for Variable Length Human Motion Generationcited by 61
- 2021Single-Shot Motion Completion with Transformercited by 59
- 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
- 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 53
- 2022MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labelscited by 45
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 29; 2025: 40; 2026: 18.
88 papers.
Sort:
By area:
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
- 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
- 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
- 2025GENMO: A GENeralist Model for Human MOtioncited by 43
38 more
- 2025Motion Anything: Any to Motion Generationcited by 40
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025Efficient Diffusion Models: A Surveycited by 35
- 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
- 2025Absolute Coordinates Make Motion Generation Easycited by 27
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 26
- 2024PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarioscited by 24
- 2024InterDance:Reactive 3D Dance Generation with Realistic Duet Interactionscited by 22
- 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 19
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
- 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 16
- 2025HERO: Human Reaction Generation from Videoscited by 15
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
- 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
- 2024SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generationcited by 12
- 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarioscited by 11
- 2025MOSPA: Human Motion Generation Driven by Spatial Audiocited by 11
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 10
- 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 10
- 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
- 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
- 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
- 2024Move-in-2D: 2D-Conditioned Human Motion Generationcited by 8
- 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8
- 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 2025ModSkill: Physical Character Skill Modularizationcited by 7
- 2025EgoReAct: Egocentric Video-Driven 3D Human Reaction Generationcited by 7
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
- 2025Zero-Shot Trajectory Planning for Signal Temporal Logic Taskscited by 6
- 20253D Human Interaction Generation: A Surveycited by 6
- 2025DIMO: Diverse 3D Motion Generation for Arbitrary Objectscited by 6
- 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Modelscited by 6
50 most cited of 88 All 88 (JSON)
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion28 Sep 2026
- 2026MoSAT: Human Motion Generation from Spatial Audio and Textual Description20 Sep 2026
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objects8 Jul 2026
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026In-Context Model Predictive Generation: Open-Vocabulary Motion Synthesis from Language Models to Physics25 Jun 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026Marrying Text-to-Motion Generation with Skeleton-Based Action Recognition18 Apr 2026
- 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions17 Apr 2026
- 2026UNICA: A Unified Neural Framework for Controllable 3D Avatars3 Apr 2026
- 2026NOUS: Video-Driven 3D Human Reaction Generation via Observation-Reaction Mutual Steering20 Mar 2026
- 2026Controllable Text-to-Motion Generation via Modular Body-Part Phase Control20 Mar 2026
38 more
- 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priors16 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026PMG: Parameterized Motion Generator for Human-like Locomotion Control13 Feb 2026
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation9 Feb 2026
- 2026Language-Guided Transformer Tokenizer for Human Motion Generation9 Feb 2026
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videos15 Jan 2026
- 2025EgoReAct: Egocentric Video-Driven 3D Human Reaction Generation28 Dec 2025
- 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models22 Dec 2025
- 2025MoLingo: Motion-Language Alignment for Text-to-Human Motion Generation15 Dec 2025
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025DIMO: Diverse 3D Motion Generation for Arbitrary Objects10 Nov 2025
- 2025MoSa: Motion Generation with Scalable Autoregressive Modeling3 Nov 2025
- 2025Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles26 Oct 2025
- 2025SceneAdapt: Scene-aware Adaptation of Human Motion Diffusion14 Oct 2025
- 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generation7 Oct 2025
- 2025MoGIC: Boosting Motion Generation via Intention Understanding and Visual Context3 Oct 2025
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep 2025
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondence18 Aug 2025
- 2025MOSPA: Human Motion Generation Driven by Spatial Audio16 Jul 2025
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data9 Jul 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models18 Jun 2025
- 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios3 Jun 2025
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects27 May 2025
- 2025Absolute Coordinates Make Motion Generation Easy26 May 2025
- 2025Text-driven Motion Generation: Overview, Challenges and Directions14 May 2025
- 2025GENMO: A GENeralist Model for Human MOtion2 May 2025
- 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input11 Apr 2025
- 2025FlowMotion: Target-Predictive Conditional Flow Matching for Jitter-Reduced Text-Driven Human Motion Generation2 Apr 2025
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Models1 Apr 2025
- 2025CBIL: Collective Behavior Imitation Learning for Fish from Real Videos31 Mar 2025
- 2025SocialGen: Modeling Multi-Human Social Interaction with Language Models28 Mar 2025
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization25 Mar 2025
- 2025GenM3: Generative Pretrained Multi-path Motion Model for Text Conditional Human Motion Generation19 Mar 2025
- 2025Progressive Human Motion Generation Based on Text and Few Motion Frames17 Mar 2025
- 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generation17 Mar 2025
- 20253D Human Interaction Generation: A Survey17 Mar 2025
- 2025HERO: Human Reaction Generation from Videos11 Mar 2025
50 newest of 88 All 88 (JSON)
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025Efficient Diffusion Models: A Surveycited by 35
- 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
- 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
- 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
12 most cited of 22 All 22 (JSON)
- 2026BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion28 Sep 2026
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching25 Apr 2026
- 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions17 Apr 2026
- 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models22 Dec 2025
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep 2025
- 2025Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models18 Jun 2025
- 2025FlowMotion: Target-Predictive Conditional Flow Matching for Jitter-Reduced Text-Driven Human Motion Generation2 Apr 2025
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Models1 Apr 2025
- 2025Efficient Diffusion Models: A Survey3 Feb 2025
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer21 Dec 2024
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control20 Dec 2024
- 2024It Takes Two: Real-time Co-Speech Two-person's Interaction Generation via Reactive Auto-regressive Diffusion Model3 Dec 2024
12 newest of 22 All 22 (JSON)
- 2025CBIL: Collective Behavior Imitation Learning for Fish from Real Videos31 Mar 2025
- 2025ModSkill: Physical Character Skill Modularization19 Feb 2025
- 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
- 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
- 2025GENMO: A GENeralist Model for Human MOtioncited by 43
- 2025Motion Anything: Any to Motion Generationcited by 40
- 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
- 2025Absolute Coordinates Make Motion Generation Easycited by 27
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 26
12 most cited of 61 All 61 (JSON)
- 2026MoSAT: Human Motion Generation from Spatial Audio and Textual Description20 Sep 2026
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objects8 Jul 2026
- 2026Training-free Controllable Human Motion Generation under Heterogeneous Constraints2 Jul 2026
- 2026In-Context Model Predictive Generation: Open-Vocabulary Motion Synthesis from Language Models to Physics25 Jun 2026
- 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Control14 May 2026
- 2026Marrying Text-to-Motion Generation with Skeleton-Based Action Recognition18 Apr 2026
- 2026UNICA: A Unified Neural Framework for Controllable 3D Avatars3 Apr 2026
- 2026NOUS: Video-Driven 3D Human Reaction Generation via Observation-Reaction Mutual Steering20 Mar 2026
- 2026Controllable Text-to-Motion Generation via Modular Body-Part Phase Control20 Mar 2026
- 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priors16 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026PMG: Parameterized Motion Generator for Human-like Locomotion Control13 Feb 2026
12 newest of 61 All 61 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2022VIDM: Video Implicit Diffusion Models
- 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3
- 2025Unconditional Human Motion and Shape Generation via Balanced Score-Based Diffusion
- 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Training
- 2022Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
- 2023Video Probabilistic Diffusion Models in Projected Latent Space
- 2025Back to Basics: Motion Representation Matters for Human Motion Generation Using Diffusion Model