mlsanityData to 7 Oct 2026

Pose Representations for Deep Skeletal Animation

arXiv 2111.13907 ↗First posted 27 Nov 2021cs.CV cs.GRcited by 4

Not on the map. Why?

Abstract (arXiv)

Data-driven character animation techniques rely on the existence of a properly established model of motion, capable of describing its rich context. However, commonly used motion representations often fail to accurately encode the full articulation of motion, or present artifacts. In this work, we address the fundamental problem of finding a robust pose representation for motion modeling, suitable for deep character animation, one that can better constrain poses and faithfully capture nuances correlated with skeletal characteristics. Our representation is based on dual quaternions, the mathematical abstractions with well-defined operations, which simultaneously encode rotational and positional orientation, enabling a hierarchy-aware encoding, centered around the root. We demonstrate that our representation overcomes common motion artifacts, and assess its performance compared to other popular representations. We conduct an ablation study to evaluate the impact of various losses that can be incorporated during learning. Leveraging the fact that our representation implicitly encodes skeletal motion attributes, we train a network on a dataset comprising of skeletons with different proportions, without the need to retarget them first to a universal skeleton, which causes subtle motion elements to be missed. We show that smooth and natural poses can be achieved, paving the way for fascinating applications.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 54 references that are in the map. First posted on arXiv 27 Nov 2021.

Builds on

25 of 54 references.

References · 25

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  3. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  4. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  5. 2017On human motion prediction using recurrent neural networkscited by 336
  6. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  7. 2021Robust Motion In-betweeningcited by 223
  8. 2021Character Controllers Using Motion VAEscited by 182
  9. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  10. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 118
  11. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
  12. 2017Deep representation learning for human motion prediction and classificationcited by 97
13 more
  1. 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
  2. 2018A Neural Temporal Model for Human Motion Predictioncited by 87
  3. 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 85
  4. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  5. 2021Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structurecited by 53
  6. 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
  7. 2018Combining Recurrent Neural Networks and Adversarial Training for Human Motion Synthesis and Controlcited by 39
  8. 2019Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modelingcited by 32
  9. 2020MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistencycited by 31
  10. 2020A Smooth Representation of Belief over SO(3) for Deep Rotation Learning with Uncertaintycited by 29
  11. 2021A Survey on Deep Learning for Skeleton-Based Human Animationcited by 26
  12. 2020Revisiting the Continuity of Rotation Representations in Neural Networkscited by 8
  13. 2019Towards Robust Direction Invariance in Character Animationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.

4 papers.