mlsanityData to 7 Oct 2026

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis

arXiv 2212.04495 ↗First posted 8 Dec 2022cs.CVcited by 218

Not on the map. Why?

Cited by 61 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Conventional methods for human motion synthesis are either deterministic or struggle with the trade-off between motion diversity and motion quality. In response to these limitations, we introduce MoFusion, i.e., a new denoising-diffusion-based framework for high-quality conditional human motion synthesis that can generate long, temporally plausible, and semantically accurate motions based on a range of conditioning contexts (such as music and text). We also present ways to introduce well-known kinematic losses for motion plausibility within the motion diffusion framework through our scheduled weighting strategy. The learned latent space can be used for several interactive motion editing applications -- like inbetweening, seed conditioning, and text-based editing -- thus, providing crucial abilities for virtual character animation and robotics. Through comprehensive quantitative evaluations and a perceptual user study, we demonstrate the effectiveness of MoFusion compared to the state of the art on established benchmarks in the literature. We urge the reader to watch our supplementary video and visit https://vcai.mpi-inf.mpg.de/projects/MoFusion.

Key facts. Cited by 218 papers in the map (data through 7 Oct 2026). Builds on 55 of its 78 references that are in the map. First posted on arXiv 8 Dec 2022.

Builds on

55 of 78 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 2022Classifier-Free Diffusion Guidancecited by 5,717
38 more
  1. 2017Neural Discrete Representation Learningcited by 4,650
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  5. 2022Human Motion Diffusion Modelcited by 1,062
  6. 2022Diffusion Models in Vision: A Surveycited by 1,008
  7. 2017End-to-end Recovery of Human Shape and Posecited by 883
  8. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  10. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  11. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  12. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  13. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  14. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  15. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  16. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  17. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  18. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
  19. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  20. 2017On human motion prediction using recurrent neural networkscited by 336
  21. 2016The KIT Motion-Language Datasetcited by 334
  22. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  23. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  24. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  25. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  26. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  27. 2019Learning Individual Styles of Conversational Gesturecited by 190
  28. 2021Character Controllers Using Motion VAEscited by 182
  29. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  30. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 114
  31. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  32. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
  33. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  34. 2021Learning Speech-driven 3D Conversational Gestures from Videocited by 98
  35. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  36. 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
  37. 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
  38. 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 52; 2024: 68; 2025: 65; 2026: 33.

218 papers.

Sort:

By area:

  1. 2023Human Motion Diffusion as a Generative Priorcited by 354
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  4. 2023Object Motion Guided Human Motion Synthesiscited by 206
  5. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  6. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  7. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  8. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  9. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  10. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
  11. 2023Controllable Human-Object Interaction Synthesiscited by 107
  12. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
38 more
  1. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  2. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  3. 2023Human Motion Generation: A Surveycited by 95
  4. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 89
  5. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
  6. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
  7. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  8. 2023DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Modelscited by 85
  9. 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
  10. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  11. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  12. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
  13. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 72
  14. 2024Flexible Motion In-betweening with Diffusion Modelscited by 69
  15. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  16. 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 66
  17. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  18. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  19. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  20. 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 62
  21. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  22. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 56
  23. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  24. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 52
  25. 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
  26. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  27. 2023Reuse and Diffuse: Iterative Denoising for Text-to-Video Generationcited by 49
  28. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  29. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
  30. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
  31. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  32. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
  33. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
  34. 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
  35. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
  36. 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
  37. 2024ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesiscited by 41
  38. 2023QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generationcited by 40

50 most cited of 218 All 218 (JSON)