Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phases
Not on the map. Why?
Abstract (arXiv)
Controlling the manner in which a character moves in a real-time animation system is a challenging task with useful applications. Existing style transfer systems require access to a reference content motion clip, however, in real-time systems the future motion content is unknown and liable to change with user input. In this work we present a style modelling system that uses an animation synthesis network to model motion content based on local motion phases. An additional style modulation network uses feature-wise transformations to modulate style in real-time. To evaluate our method, we create and release a new style modelling dataset, 100STYLE, containing over 4 million frames of stylised locomotion data in 100 different styles that present a number of challenges for existing systems. To model these styles, we extend the local phase calculation with a contact-free formulation. In comparison to other methods for real-time style modelling, we show our system is more robust and efficient in its style representation while improving motion quality.
Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). Builds on 23 of its 63 references that are in the map. First posted on arXiv 12 Jan 2022.
Builds on
23 of 63 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Learning multiple visual domains with residual adapterscited by 557
- 2015A Neural Algorithm of Artistic Stylecited by 483
- 2016A Learned Representation For Artistic Stylecited by 341
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
- 2021Character Controllers Using Motion VAEscited by 184
- 2018Efficient parametrization of multi-domain deep neural networkscited by 168
11 more
- 2018DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skillscited by 163
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
- 2017Deep representation learning for human motion prediction and classificationcited by 98
- 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
- 2018Learning Symmetric and Low-energy Locomotioncited by 61
- 2021Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restorationcited by 50
- 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
- 2020Source Free Domain Adaptation with Image Translationcited by 21
- 2021Test Sample Accuracy Scales with Training Sample Density in Neural Networkscited by 9
- 2017Auto-Conditioned Recurrent Networks for Extended Complex Human Motion Synthesiscited by 6
- 2019Customizing Sequence Generation with Multi-Task Dynamical Systemscited by 5
Built on by
Citing papers per year: 2022: 5; 2023: 8; 2024: 11; 2025: 28; 2026: 20.
72 papers.
Sort:
By area:
- 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
- 2023Human Motion Generation: A Surveycited by 96
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
- 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
- 2025A Survey on Human Interaction Motion Generationcited by 25
38 more
- 2022GANimator: Neural Motion Synthesis from a Single Sequencecited by 23
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2022Dance Style Transfer with Cross-modal Transformercited by 20
- 2023RSMT: Real-time Stylized Motion Transition for Characterscited by 19
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 18
- 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
- 2025SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Controlcited by 15
- 2025PersonaBooth: Personalized Text-to-Motion Generationcited by 14
- 2024SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generationcited by 12
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Spacecited by 10
- 2023Motion Capture Dataset for Practical Use of AI-based Motion Editing and Stylizationcited by 9
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 2024Diffusion-based Human Motion Style Transfer with Semantic Guidancecited by 7
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videoscited by 7
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generationcited by 6
- 2025UniMoGen: Universal Motion Generationcited by 5
- 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editingcited by 5
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Controlcited by 5
- 2023Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phasecited by 4
- 2023Scalable Motion Style Transfer with Constrained Diffusion Generationcited by 4
- 2024Decoupling Contact for Fine-Grained Motion Style Transfercited by 4
- 2024Real-time Diverse Motion In-betweening with Space-time Controlcited by 4
- 2025SMooGPT: Stylized Motion Generation using Large Language Modelscited by 4
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generationcited by 4
- 2024SMGDiff: Soccer Motion Generation using diffusion probabilistic modelscited by 3
- 2025Towards Synthesized and Editable Motion In-Betweening Through Part-Wise Phase Representationcited by 3
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Taskscited by 3
- 2026VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representationscited by 3
- 2024MulSMo: Multimodal Stylized Motion Generation by Bidirectional Control Flowcited by 2
- 2025ASMR: Adaptive Skeleton-Mesh Rigging and Skinning via 2D Generative Priorcited by 2
- 2025Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognitioncited by 2
- 2026ReActor: Reinforcement Learning for Physics-Aware Motion Retargetingcited by 2
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026Scaling Behavior Foundation Model for Humanoid Robotscited by 2
- 2025ACMo: Attribute Controllable Motion Generationcited by 1
- 2025RESCUE: Crowd Evacuation Simulation via Controlling SDM-United Characterscited by 1
50 most cited of 72 All 72 (JSON)
- 2026CurveCodec 2: Skeleton-agnostic animation compression with a learned entropy model3 Oct 2026
- 2026Retargeting Motions to Diverse Skeletons via Learnable Flattening29 Sep 2026
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion25 Sep 2026
- 2026VISTA: Video-Injected Stylized Text-to-Animation20 Sep 2026
- 2026MorphoStyle: Motion Style Transfer with Morphology Control12 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026STyMo: Fast and Controllable Few-Shot Motion Style Transfer3 Sep 2026
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users30 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation7 Jul 2026
- 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control29 Jun 2026
- 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition11 Jun 2026
38 more
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2026Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation13 May 2026
- 2026ReActor: Reinforcement Learning for Physics-Aware Motion Retargeting7 May 2026
- 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation21 Apr 2026
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control29 Mar 2026
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens12 Feb 2026
- 2026VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representations2 Feb 2026
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos3 Jan 2026
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec 2025
- 2025Towards Unified Co-Speech Gesture Generation via Hierarchical Implicit Periodicity Learning15 Dec 2025
- 2025FunPhase: A Periodic Functional Autoencoder for Motion Generation via Phase Manifolds10 Dec 2025
- 2025SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Control2 Dec 2025
- 2025ClusterStyle: Modeling Intra-Style Diversity with Prototypical Clustering for Stylized Motion Generation2 Dec 2025
- 2025Understanding the Representation of Older Adults in Motion Capture Locomotion Datasets12 Nov 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation22 Oct 2025
- 2025Deep Compositional Phase Diffusion for Long Motion Sequence Generation16 Oct 2025
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System13 Oct 2025
- 2025Motion In-Betweening for Densely Interacting Characters30 Sep 2025
- 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editing28 Sep 2025
- 2025SMooGPT: Stylized Motion Generation using Large Language Models4 Sep 2025
- 2025MVRS: The Multimodal Virtual Reality Stimuli-based Emotion Recognition Dataset31 Aug 2025
- 2025PersonaAnimator: Personalized Motion Transfer from Unconstrained Videos27 Aug 2025
- 2025Controllable Single-shot Animation Blending with Temporal Conditioning25 Aug 2025
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks27 Jul 2025
- 2025RESCUE: Crowd Evacuation Simulation via Controlling SDM-United Characters27 Jul 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025UniMoGen: Universal Motion Generation28 May 2025
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion27 Mar 2025
- 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusion25 Mar 2025
- 2025ASMR: Adaptive Skeleton-Mesh Rigging and Skinning via 2D Generative Prior17 Mar 2025
- 2025A Survey on Human Interaction Motion Generation17 Mar 2025
- 2025ACMo: Attribute Controllable Motion Generation14 Mar 2025
- 2025Synthetic Data Generation of Body Motion Data by Neural Gas Network for Emotion Recognition11 Mar 2025
- 2025Towards Synthesized and Editable Motion In-Betweening Through Part-Wise Phase Representation11 Mar 2025
- 2025PersonaBooth: Personalized Text-to-Motion Generation10 Mar 2025
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Model19 Dec 2024
- 2024MulSMo: Multimodal Stylized Motion Generation by Bidirectional Control Flow13 Dec 2024
50 newest of 72 All 72 (JSON)
- 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
- 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
- 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2022Pretrained Diffusion Models for Unified Human Motion Synthesiscited by 26
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2024Diffusion-based Human Motion Style Transfer with Semantic Guidancecited by 7
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videoscited by 7
- 2025SMooGPT: Stylized Motion Generation using Large Language Modelscited by 4
12 most cited of 16 All 16 (JSON)
- 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation7 Jul 2026
- 2026Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation13 May 2026
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos3 Jan 2026
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec 2025
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation30 Oct 2025
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation22 Oct 2025
- 2025SMooGPT: Stylized Motion Generation using Large Language Models4 Sep 2025
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion27 Mar 2025
- 2024SMGDiff: Soccer Motion Generation using diffusion probabilistic models25 Nov 2024
- 2024SMooDi: Stylized Motion Diffusion Model17 Jul 2024
- 2024Taming Diffusion Probabilistic Models for Character Control23 Apr 2024
- 2024Diffusion-based Human Motion Style Transfer with Semantic Guidance20 Mar 2024
12 newest of 16 All 16 (JSON)
- 2023Human Motion Generation: A Surveycited by 96
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2025A Survey on Human Interaction Motion Generationcited by 25
- 2022GANimator: Neural Motion Synthesis from a Single Sequencecited by 23
- 2022Dance Style Transfer with Cross-modal Transformercited by 20
- 2023RSMT: Real-time Stylized Motion Transition for Characterscited by 19
- 2025PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction Systemcited by 18
- 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
- 2025PersonaBooth: Personalized Text-to-Motion Generationcited by 14
- 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
12 most cited of 52 All 52 (JSON)
- 2026CurveCodec 2: Skeleton-agnostic animation compression with a learned entropy model3 Oct 2026
- 2026Retargeting Motions to Diverse Skeletons via Learnable Flattening29 Sep 2026
- 2026Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion25 Sep 2026
- 2026VISTA: Video-Injected Stylized Text-to-Animation20 Sep 2026
- 2026MorphoStyle: Motion Style Transfer with Morphology Control12 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026STyMo: Fast and Controllable Few-Shot Motion Style Transfer3 Sep 2026
- 2026MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users30 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control29 Jun 2026
- 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition11 Jun 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
12 newest of 52 All 52 (JSON)