mlsanityData to 7 Oct 2026

MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model

arXiv 2404.19759 ↗First posted 30 Apr 2024cs.CVcited by 164

On the map: Diffusion models → Video generation

Abstract (arXiv)

This work introduces MotionLCM, extending controllable motion generation to a real-time level. Existing methods for spatial-temporal control in text-conditioned motion generation suffer from significant runtime inefficiency. To address this issue, we first propose the motion latent consistency model (MotionLCM) for motion generation, building on the motion latent diffusion model. By adopting one-step (or few-step) inference, we further improve the runtime efficiency of the motion latent diffusion model for motion generation. To ensure effective controllability, we incorporate a motion ControlNet within the latent space of MotionLCM and enable explicit control signals (i.e., initial motions) in the vanilla motion space to further provide supervision for the training process. By employing these techniques, our approach can generate human motions with text and control signals in real-time. Experimental results demonstrate the remarkable generation and controlling capabilities of MotionLCM while maintaining real-time runtime efficiency.

Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 75 of its 94 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

75 of 94 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance26 Mar
  2. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation4 Dec
  3. 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model2 Dec
  4. 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
  5. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  6. 2023Human Motion Diffusion as a Generative Prior2 Mar
  7. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  8. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  9. 2022Human Motion Diffusion Model29 Sep
  10. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 65

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  2. 2023Consistency Modelscited by 1,778
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  4. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  5. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  6. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  8. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  9. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  10. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  11. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  12. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  13. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  14. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  15. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  16. 2016The KIT Motion-Language Datasetcited by 334
  17. 2022EDGE: Editable Dance Generation From Musiccited by 284
  18. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  19. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  20. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  21. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  22. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  23. 2019Are Anchor Points Really Indispensable in Label-Noise Learning?cited by 208
  24. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  25. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  26. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  27. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  28. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
  29. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  30. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  31. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  32. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
  33. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  34. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 93
  35. 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 91
  36. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  37. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  38. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 26; 2025: 74; 2026: 64.

164 papers.

Sort:

By area:

  1. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
  3. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  4. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  5. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  6. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
  7. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  8. 2024ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulationcited by 57
  9. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  10. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
  11. 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 46
  12. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 43
38 more
  1. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  2. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
  3. 2025Motion Anything: Any to Motion Generationcited by 40
  4. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
  5. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  6. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 37
  7. 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
  8. 2025HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Modelscited by 32
  9. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 32
  10. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  11. 2024Unimotion: Unifying 3D Human Motion Synthesis and Understandingcited by 29
  12. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  13. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
  14. 2024KinMo: Kinematic-aware Human Motion Understanding and Generationcited by 21
  15. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 20
  16. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 19
  17. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
  18. 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decodingcited by 17
  19. 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
  20. 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 16
  21. 2025HERO: Human Reaction Generation from Videoscited by 15
  22. 2024SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimizationcited by 14
  23. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  24. 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 13
  25. 2025Dynamic Motion Blending for Versatile Motion Editingcited by 13
  26. 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
  27. 2025MOSPA: Human Motion Generation Driven by Spatial Audiocited by 11
  28. 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignmentcited by 10
  29. 2024MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Trainingcited by 9
  30. 2024Hierarchical Memory for Long Video QAcited by 9
  31. 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
  32. 2025MotionPCM: Real-Time Motion Synthesis with Phased Consistency Modelcited by 9
  33. 2025Motion Synthesis with Sparse and Flexible Keyjoint Controlcited by 9
  34. 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
  35. 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusioncited by 9
  36. 2024Textual Decomposition Then Sub-motion-space Scattering for Open-Vocabulary Motion Generationcited by 8
  37. 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
  38. 2025Progressive Human Motion Generation Based on Text and Few Motion Framescited by 8

50 most cited of 164 All 164 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Strong and Controllable 3D Motion Generation
  2. 2025Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Loss
  3. 2024Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation
  4. 2024MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation
  5. 2023Synthesizing Long-Term Human Motions with Diffusion Models via Coherent Sampling
  6. 2025LaMoGen: Laban Movement-Guided Diffusion for Text-to-Motion Generation
  7. 2026Coordinating Multiple Conditions for Trajectory-Controlled Human Motion Generation
  8. 2024Motion Prompting: Controlling Video Generation with Motion Trajectories