GANimator: Neural Motion Synthesis from a Single Sequence
Not on the map. Why?
Abstract (arXiv)
We present GANimator, a generative model that learns to synthesize novel motions from a single, short motion sequence. GANimator generates motions that resemble the core elements of the original motion, while simultaneously synthesizing novel and diverse movements. Existing data-driven techniques for motion synthesis require a large motion dataset which contains the desired and specific skeletal structure. By contrast, GANimator only requires training on a single motion sequence, enabling novel motion synthesis for a variety of skeletal structures e.g., bipeds, quadropeds, hexapeds, and more. Our framework contains a series of generative and adversarial neural networks, each responsible for generating motions in a specific frame rate. The framework progressively learns to synthesize motion from random noise, enabling hierarchical control over the generated motion content across varying levels of detail. We show a number of applications, including crowd simulation, key-frame editing, style transfer, and interactive control, which all learn from a single input sequence. Code and data for this paper are at https://peizhuoli.github.io/ganimator.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 23 of its 77 references that are in the map. First posted on arXiv 5 May 2022.
Builds on
23 of 77 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2021Robust Motion In-betweeningcited by 229
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2017Emergence of Locomotion Behaviours in Rich Environmentscited by 165
11 more
- 2018DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skillscited by 163
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 109
- 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
- 2020Improved Techniques for Training Single-Image GANscited by 78
- 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
- 2021Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structurecited by 53
- 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
- 2019Learning Character-Agnostic Motion for Motion Retargeting in 2Dcited by 45
- 2021A Survey on Deep Learning for Skeleton-Based Human Animationcited by 27
Built on by
Citing papers per year: 2022: 3; 2023: 8; 2024: 7; 2025: 4; 2026: 1.
23 papers.
Sort:
By area:
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 158
- 2023MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representationscited by 60
- 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2025AnyTop: Character Animation Diffusion with Any Topologycited by 41
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
- 2023MotionScript: Natural Language Descriptions for Expressive 3D Human Motionscited by 21
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 19
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 17
- 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
11 more
- 2024Matting by Generationcited by 13
- 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scenecited by 11
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Spacecited by 10
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
- 2022Interaction Mix and Match: Synthesizing Close Interaction using Conditional Hierarchical GAN with Multi-Hot Class Embeddingcited by 6
- 2024LS-GAN: Human Motion Synthesis with Latent-space GANscited by 5
- 2024Real-time Diverse Motion In-betweening with Space-time Controlcited by 4
- 2024ELMO: Enhanced Real-time LiDAR Motion Capture through Upsamplingcited by 1
- 2025Controllable Single-shot Animation Blending with Temporal Conditioningcited by 1
- 2026TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animationcited by 1
- 2024Multi-Resolution Generative Modeling of Human Motion from Limited Datacited by 0
- 2026TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation10 Jun 2026
- 2025Controllable Single-shot Animation Blending with Temporal Conditioning25 Aug 2025
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondence18 Aug 2025
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation27 Apr 2025
- 2025AnyTop: Character Animation Diffusion with Any Topology24 Feb 2025
- 2024LS-GAN: Human Motion Synthesis with Latent-space GANs30 Dec 2024
- 2024Multi-Resolution Generative Modeling of Human Motion from Limited Data25 Nov 2024
- 2024ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling9 Oct 2024
- 2024Real-time Diverse Motion In-betweening with Space-time Control30 Sep 2024
- 2024Matting by Generation30 Jul 2024
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfer10 Jun 2024
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Space18 Mar 2024
11 more
- 2023MotionScript: Natural Language Descriptions for Expressive 3D Human Motions19 Dec 2023
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion7 Dec 2023
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior31 Oct 2023
- 2023MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representations16 Oct 2023
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun 2023
- 2023Example-based Motion Synthesis via Generative Motion Matching1 Jun 2023
- 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents26 Mar 2023
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations15 Jan 2023
- 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene30 Nov 2022
- 2022Interaction Mix and Match: Synthesizing Close Interaction using Conditional Hierarchical GAN with Multi-Hot Class Embedding23 Jul 2022
- 2022MoDi: Unconditional Motion Synthesis from Diverse Data16 Jun 2022
- 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 158
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
- 2024LS-GAN: Human Motion Synthesis with Latent-space GANscited by 5
- 2024LS-GAN: Human Motion Synthesis with Latent-space GANs30 Dec 2024
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfer10 Jun 2024
- 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion7 Dec 2023
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Models1 Jun 2023
- 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents26 Mar 2023
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2023MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representationscited by 60
- 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
- 2025AnyTop: Character Animation Diffusion with Any Topologycited by 41
- 2023MotionScript: Natural Language Descriptions for Expressive 3D Human Motionscited by 21
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondencecited by 19
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 17
- 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
- 2024Matting by Generationcited by 13
- 2022SinGRAF: Learning a 3D Generative Radiance Field for a Single Scenecited by 11
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Spacecited by 10
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
12 most cited of 18 All 18 (JSON)
- 2026TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation10 Jun 2026
- 2025Controllable Single-shot Animation Blending with Temporal Conditioning25 Aug 2025
- 2025Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondence18 Aug 2025
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation27 Apr 2025
- 2025AnyTop: Character Animation Diffusion with Any Topology24 Feb 2025
- 2024Multi-Resolution Generative Modeling of Human Motion from Limited Data25 Nov 2024
- 2024ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling9 Oct 2024
- 2024Real-time Diverse Motion In-betweening with Space-time Control30 Sep 2024
- 2024Matting by Generation30 Jul 2024
- 2024Generative Motion Stylization of Cross-structure Characters within Canonical Motion Space18 Mar 2024
- 2023MotionScript: Natural Language Descriptions for Expressive 3D Human Motions19 Dec 2023
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior31 Oct 2023
12 newest of 18 All 18 (JSON)