Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-driven motion diffusion models are capable of generating realistic human motions, but text alone often struggles to express fine-level nuances of motion, commonly referred to as style. Recent approaches have tackled this challenge by attaching a style injection mechanism to a pretrained text-driven diffusion model. Existing stylization methods, however, either require style-specific fine-tuning of existing models or rely on heavy ControlNet-based architectures, limiting efficiency and generalization to unseen styles. We propose a lightweight style conditioning framework that dynamically modulates a pretrained diffusion model through hypernetwork-generated LoRA parameters. A style reference motion is encoded into a global style embedding, which is mapped by a hypernetwork to low-rank updates applied at each denoising step of the diffusion model. By structuring the style latent space with a supervised contrastive loss, our framework reliably captures diverse stylistic attributes, improves generalization to unseen styles, and supports optimization-based guidance without requiring predefined style categories. Experiments on the HumanML3D and 100STYLE datasets show state-of-the-art stylization results, while achieving improved stylization for unseen styles.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 28 of its 40 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
28 of 40 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2020Supervised Contrastive Learningcited by 2,829
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2022Human Motion Diffusion Modelcited by 1,080
- 2016HyperNetworkscited by 1,027
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
16 more
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 98
- 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
- 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
- 2022Motion Puzzle: Arbitrary Motion Style Transfer by Body Partcited by 64
- 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
- 2024Generative Human Motion Stylization in Latent Spacecited by 30
- 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Spacecited by 10
- 2024Length-Aware Motion Synthesis via Latent Diffusioncited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion-based Human Motion Style Transfer with Semantic Guidance
- 2026Flexible Motion Generation from Language and Style References
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion
- 2024SMooDi: Stylized Motion Diffusion Model
- 2022Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
- 2023Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
- 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models
- 2024ArtWeaver: Advanced Dynamic Style Integration via Diffusion Model