mlsanityData to 7 Oct 2026

Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifolds

arXiv 2210.01672 ↗First posted 4 Oct 2022cs.RO cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Human motion taxonomies serve as high-level hierarchical abstractions that classify how humans move and interact with their environment. They have proven useful to analyse grasps, manipulation skills, and whole-body support poses. Despite substantial efforts devoted to design their hierarchy and underlying categories, their use remains limited. This may be attributed to the lack of computational models that fill the gap between the discrete hierarchical structure of the taxonomy and the high-dimensional heterogeneous data associated to its categories. To overcome this problem, we propose to model taxonomy data via hyperbolic embeddings that capture the associated hierarchical structure. We achieve this by formulating a novel Gaussian process hyperbolic latent variable model that incorporates the taxonomy structure through graph-based priors on the latent space and distance-preserving back constraints. We validate our model on three different human motion taxonomies to learn hyperbolic embeddings that faithfully preserve the original graph structure. We show that our model properly encodes unseen data from existing or new taxonomy categories, and outperforms its Euclidean and VAE-based counterparts. Finally, through proof-of-concept experiments, we show that our model may be used to generate realistic trajectories between the learned embeddings.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 26 of its 72 references that are in the map. First posted on arXiv 4 Oct 2022.

Builds on

26 of 72 references.

References · 26

  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  2. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  3. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
  4. 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 261
  5. 2014Scalable Variational Gaussian Process Classificationcited by 226
  6. 2018Riemannian Adaptive Optimization Methodscited by 187
  7. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  8. 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
  9. 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
  10. 2020Geoopt: Riemannian Optimization in PyTorchcited by 109
  11. 2019Mixed-curvature Variational Autoencoderscited by 85
  12. 2020Mat'ern Gaussian processes on Riemannian manifoldscited by 82
14 more
  1. 2020From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clusteringcited by 65
  2. 2020Mat'ern Gaussian Processes on Graphscited by 65
  3. 2020Latent Variable Modelling with Hyperbolic Normalizing Flowscited by 49
  4. 2021Adversarial Parametric Pose Priorcited by 38
  5. 2020Computationally Tractable Riemannian Manifolds for Graph Embeddingscited by 29
  6. 2014Metrics for Probabilistic Geometriescited by 28
  7. 2021Geometry-aware Bayesian Optimization in Robotics using Riemannian Mat'ern Kernelscited by 24
  8. 2022Heterogeneous manifolds for curvature-aware graph embeddingcited by 23
  9. 2022Rethinking the compositionality of point clouds through regularization in the hyperbolic spacecited by 18
  10. 2021Neural Distance Embeddings for Biological Sequencescited by 17
  11. 2020Manifold GPLVMs for discovering non-Euclidean latent structure in neural datacited by 14
  12. 2020A Motion Taxonomy for Manipulation Embeddingcited by 9
  13. 2019Manipulation Motion Taxonomy and Coding for Robotscited by 5
  14. 2020Isometric Gaussian Process Latent Variable Model for Dissimilarity Datacited by 3

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 4; 2025: 4.

9 papers.