mlsanityData to 14 Oct 2026

SMooDi: Stylized Motion Diffusion Model

arXiv 2407.12783 ↗First posted 17 Jul 2024cs.CV cs.GRcited by 37

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized motion driven by content texts and style motion sequences. Unlike existing methods that either generate motion of various content or transfer style from one sequence to another, SMooDi can rapidly generate motion across a broad range of content and diverse styles. To this end, we tailor a pre-trained text-to-motion model for stylization. Specifically, we propose style guidance to ensure that the generated motion closely matches the reference style, alongside a lightweight style adaptor that directs the motion towards the desired style while ensuring realism. Experiments across various applications demonstrate that our proposed framework outperforms existing methods in stylized motion generation.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 53 of its 63 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

53 of 63 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation19 Oct
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2023Consistency Modelscited by 1,822
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  9. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  10. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  12. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
38 more
  1. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  2. 2023Human Motion Diffusion as a Generative Priorcited by 357
  3. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  4. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  5. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  6. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  7. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  8. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
  9. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  10. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  11. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 158
  12. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  13. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  14. 2023MMM: Generative Masked Motion Modelcited by 131
  15. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 98
  16. 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
  17. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
  18. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 93
  19. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  20. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 90
  21. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 89
  22. 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
  23. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  24. 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
  25. 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
  26. 2023Single Motion Diffusioncited by 65
  27. 2022Motion Puzzle: Arbitrary Motion Style Transfer by Body Partcited by 64
  28. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
  29. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  30. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  31. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 47
  32. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
  33. 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
  34. 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
  35. 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
  36. 2024Generative Human Motion Stylization in Latent Spacecited by 30
  37. 2022Style-ERD: Responsive and Coherent Online Motion Style Transfercited by 17
  38. 2023AdaptNet: Policy Adaptation for Physics-Based Character Controlcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 16; 2026: 15.

37 papers.

Sort:

By area:

  1. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  2. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
  3. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  4. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
  5. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  6. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  7. 2025A Survey on Human Interaction Motion Generationcited by 25
  8. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
  9. 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
  10. 2024SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesiscited by 14
  11. 2025PersonaBooth: Personalized Text-to-Motion Generationcited by 14
  12. 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 14
25 more
  1. 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
  2. 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
  3. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
  4. 2026VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representationscited by 3
  5. 2024MulSMo: Multimodal Stylized Motion Generation by Bidirectional Control Flowcited by 2
  6. 2025ExGes: Expressive Human Motion Retrieval and Modulation for Audio-Driven Gesture Synthesiscited by 2
  7. 2026RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generationcited by 2
  8. 2025ACMo: Attribute Controllable Motion Generationcited by 1
  9. 2025RESCUE: Crowd Evacuation Simulation via Controlling SDM-United Characterscited by 1
  10. 2025ClusterStyle: Modeling Intra-Style Diversity with Prototypical Clustering for Stylized Motion Generationcited by 1
  11. 2025Controllable Long-term Motion Generation with Extended Joint Targetscited by 1
  12. 2026Sketch2Colab: Sketch-Conditioned Multi-Human Animation via Controllable Flow Distillationcited by 1
  13. 2026IAM: Identity-Aware Human Motion and Shape Joint Generationcited by 1
  14. 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generationcited by 1
  15. 2025LILAC: Long-sequence Incremental Low-latency Arbitrary Motion Stylization via Streaming VAE-Diffusion with Causal Decodingcited by 0
  16. 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
  17. 2026Robo-Saber: Generating and Simulating Virtual Reality Playerscited by 0
  18. 2026Multi-scale Coarse-to-fine Modeling for Test-time Human Motion Controlcited by 0
  19. 2026EMA: Effort Metric Attention for Anatomical Effort-Guided Human Motion Diffusioncited by 0
  20. 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognitioncited by 0
  21. 2026PoseShield: Neural Collision Fields for Human Self-Collision Resolutioncited by 0
  22. 2026MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfercited by 0
  23. 2026Flexible Motion Generation from Language and Style Referencescited by 0
  24. 2026VISTA: Video-Injected Stylized Text-to-Animationcited by 0
  25. 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SMooGPT: Stylized Motion Generation using Large Language Models
  2. 2026Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation
  3. 2024Diffusion-based Human Motion Style Transfer with Semantic Guidance
  4. 2025Training-free Stylized Text-to-Image Generation with Fast Inference
  5. 2024SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion
  6. 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priors
  7. 2022Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
  8. 2024Towards motion from video diffusion models