mlsanityData to 7 Oct 2026

Single Motion Diffusion

arXiv 2302.05905 ↗First posted 12 Feb 2023cs.CV cs.AI cs.GRcited by 65

On the map: Diffusion models → Video generation

Abstract (arXiv)

Synthesizing realistic animations of humans, animals, and even imaginary creatures, has long been a goal for artists and computer graphics professionals. Compared to the imaging domain, which is rich with large available datasets, the number of data instances for the motion domain is limited, particularly for the animation of animals and exotic creatures (e.g., dragons), which have unique skeletons and motion patterns. In this work, we present a Single Motion Diffusion Model, dubbed SinMDM, a model designed to learn the internal motifs of a single motion sequence with arbitrary topology and synthesize motions of arbitrary length that are faithful to them. We harness the power of diffusion models and present a denoising network explicitly designed for the task of learning from a single input motion. SinMDM is designed to be a lightweight architecture, which avoids overfitting by using a shallow network with local attention layers that narrow the receptive field and encourage motion diversity. SinMDM can be applied in various contexts, including spatial and temporal in-betweening, motion expansion, style transfer, and crowd animation. Our results show that SinMDM outperforms existing methods both in quality and time-space efficiency. Moreover, while current approaches require additional training for different applications, our work facilitates these applications at inference time. Our code and trained models are available at https://sinmdm.github.io/SinMDM-page.

Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 79 of its 113 references that are in the map. First posted on arXiv 12 Feb 2023.

Builds on

79 of 113 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
  2. 2022SinFusion: Training Diffusion Models on a Single Image or Video21 Nov
  3. 2022Human Motion Diffusion Model29 Sep
  4. 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 74

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
38 more
  1. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  4. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  5. 2018Self-Attention with Relative Position Representationscited by 1,112
  6. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  7. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  8. 2016Deep Networks with Stochastic Depthcited by 973
  9. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  10. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  11. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  12. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  13. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  14. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  15. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  16. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  17. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  18. 2022EDGE: Editable Dance Generation From Musiccited by 284
  19. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  20. 2021Robust Motion In-betweeningcited by 223
  21. 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
  22. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
  23. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  24. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 118
  25. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  26. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  27. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  28. 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
  29. 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
  30. 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 85
  31. 2020Improved Techniques for Training Single-Image GANscited by 77
  32. 2019A critical analysis of self-supervision, or what we can learn from a single imagecited by 75
  33. 2020Convolutional Autoencoders for Human Motion Infillingcited by 73
  34. 2020Positional Encoding as Spatial Inductive Bias in GANscited by 69
  35. 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 66
  36. 2019Boundless: Generative Adversarial Networks for Image Extensioncited by 62
  37. 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
  38. 2022Implicit Neural Representations for Variable Length Human Motion Generationcited by 61

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 22; 2025: 21; 2026: 9.

65 papers.

Sort:

By area:

  1. 2023Human Motion Diffusion as a Generative Priorcited by 354
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  4. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  5. 2023Controllable Human-Object Interaction Synthesiscited by 107
  6. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  7. 2023Generative Image Dynamicscited by 93
  8. 2024Flexible Motion In-betweening with Diffusion Modelscited by 69
  9. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  10. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  11. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  12. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 52
38 more
  1. 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
  2. 2023MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusioncited by 37
  3. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  4. 2025AnyTop: Character Animation Diffusion with Any Topologycited by 37
  5. 2024Generative Human Motion Stylization in Latent Spacecited by 30
  6. 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 30
  7. 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
  8. 2023NAP: Neural 3D Articulation Priorcited by 25
  9. 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
  10. 2025TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulationcited by 24
  11. 2024Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motioncited by 19
  12. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 17
  13. 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
  14. 2024KMM: Key Frame Mask Mamba for Extended Motion Generationcited by 16
  15. 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
  16. 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Taskcited by 14
  17. 2025Articulated Kinematics Distillation from Video Diffusion Modelscited by 13
  18. 2024T2LM: Long-Term 3D Human Motion Generation from Multiple Sentencescited by 11
  19. 2025MotionDreamer: One-to-Many Motion Synthesis with Localized Generative Masked Transformercited by 9
  20. 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
  21. 2024Diffusion-based Human Motion Style Transfer with Semantic Guidancecited by 7
  22. 2025Zero-Shot Human-Object Interaction Synthesis with Multimodal Priorscited by 7
  23. 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
  24. 2024Enhancing Prompt Following with Visual Control Through Training-Free Mask-Guided Diffusioncited by 6
  25. 2025How to Move Your Dragon: Text-to-Motion Synthesis for Large-Vocabulary Objectscited by 5
  26. 2025SMF: Template-free and Rig-free Animation Transfer using Kinetic Codescited by 5
  27. 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editingcited by 5
  28. 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animationcited by 5
  29. 2025HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidancecited by 4
  30. 2024Text me the data: Generating Ground Pressure Sequence from Textual Descriptions for HARcited by 3
  31. 2024Platypose: Calibrated Zero-Shot Multi-Hypothesis 3D Human Motion Estimationcited by 2
  32. 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 2
  33. 2024MulSMo: Multimodal Stylized Motion Generation by Bidirectional Control Flowcited by 2
  34. 2025SPG: Improving Motion Diffusion by Smooth Perturbation Guidancecited by 2
  35. 2025MoReact: Generating Reactive Motion from Textual Descriptionscited by 2
  36. 2023GaitMorph: Transforming Gait by Optimally Transporting Discrete Codescited by 1
  37. 2024Towards Practical Single-shot Motion Synthesiscited by 1
  38. 2025Fatigue-PINN: Physics-Informed Fatigue-Driven Motion Modulation and Synthesiscited by 1

50 most cited of 65 All 65 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
  2. 2023AAMDM: Accelerated Auto-regressive Motion Diffusion Model
  3. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis
  4. 2024Controllable Longer Image Animation with Diffusion Models
  5. 2025Less is More: Improving Motion Diffusion Models with Sparse Keyframes
  6. 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
  7. 2024AnaMoDiff: 2D Analogical Motion Diffusion via Disentangled Denoising
  8. 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characters