Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifolds
Not on the map. Why?
Abstract (arXiv)
Human motion taxonomies serve as high-level hierarchical abstractions that classify how humans move and interact with their environment. They have proven useful to analyse grasps, manipulation skills, and whole-body support poses. Despite substantial efforts devoted to design their hierarchy and underlying categories, their use remains limited. This may be attributed to the lack of computational models that fill the gap between the discrete hierarchical structure of the taxonomy and the high-dimensional heterogeneous data associated to its categories. To overcome this problem, we propose to model taxonomy data via hyperbolic embeddings that capture the associated hierarchical structure. We achieve this by formulating a novel Gaussian process hyperbolic latent variable model that incorporates the taxonomy structure through graph-based priors on the latent space and distance-preserving back constraints. We validate our model on three different human motion taxonomies to learn hyperbolic embeddings that faithfully preserve the original graph structure. We show that our model properly encodes unseen data from existing or new taxonomy categories, and outperforms its Euclidean and VAE-based counterparts. Finally, through proof-of-concept experiments, we show that our model may be used to generate realistic trajectories between the learned embeddings.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 26 of its 72 references that are in the map. First posted on arXiv 4 Oct 2022.
Builds on
26 of 72 references.
References · 26
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
- 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 261
- 2014Scalable Variational Gaussian Process Classificationcited by 226
- 2018Riemannian Adaptive Optimization Methodscited by 187
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
- 2020Geoopt: Riemannian Optimization in PyTorchcited by 109
- 2019Mixed-curvature Variational Autoencoderscited by 85
- 2020Mat'ern Gaussian processes on Riemannian manifoldscited by 82
14 more
- 2020From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clusteringcited by 65
- 2020Mat'ern Gaussian Processes on Graphscited by 65
- 2020Latent Variable Modelling with Hyperbolic Normalizing Flowscited by 49
- 2021Adversarial Parametric Pose Priorcited by 38
- 2020Computationally Tractable Riemannian Manifolds for Graph Embeddingscited by 29
- 2014Metrics for Probabilistic Geometriescited by 28
- 2021Geometry-aware Bayesian Optimization in Robotics using Riemannian Mat'ern Kernelscited by 24
- 2022Heterogeneous manifolds for curvature-aware graph embeddingcited by 23
- 2022Rethinking the compositionality of point clouds through regularization in the hyperbolic spacecited by 18
- 2021Neural Distance Embeddings for Biological Sequencescited by 17
- 2020Manifold GPLVMs for discovering non-Euclidean latent structure in neural datacited by 14
- 2020A Motion Taxonomy for Manipulation Embeddingcited by 9
- 2019Manipulation Motion Taxonomy and Coding for Robotscited by 5
- 2020Isometric Gaussian Process Latent Variable Model for Dissimilarity Datacited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 4.
9 papers.
- 2023Transfer Learning in Robotics: An Upcoming Breakthrough? A Review of Promises and Challengescited by 17
- 2024The GeometricKernels Package: Heat and Mat'ern Kernels for Geometric Learning on Manifolds, Meshes, and Graphscited by 10
- 2025Riemann2: Learning Riemannian Submanifolds from Riemannian Datacited by 5
- 2025Lemmanaid: Neuro-Symbolic Lemma Conjecturingcited by 5
- 2024Residual Deep Gaussian Processes on Manifoldscited by 2
- 2024On Probabilistic Pullback Metrics for Latent Hyperbolic Manifoldscited by 1
- 2025Randomized HyperSteiner: A Stochastic Delaunay Triangulation Heuristic for the Hyperbolic Steiner Minimal Treecited by 1
- 2024Hyperboloid GPLVM for Discovering Continuous Hierarchies via Nonparametric Estimationcited by 0
- 2025Taxonomy-aware Dynamic Motion Generation on Hyperbolic Manifoldscited by 0
- 2025Randomized HyperSteiner: A Stochastic Delaunay Triangulation Heuristic for the Hyperbolic Steiner Minimal Tree10 Oct 2025
- 2025Taxonomy-aware Dynamic Motion Generation on Hyperbolic Manifolds25 Sep 2025
- 2025Lemmanaid: Neuro-Symbolic Lemma Conjecturing7 Apr 2025
- 2025Riemann2: Learning Riemannian Submanifolds from Riemannian Data7 Mar 2025
- 2024Residual Deep Gaussian Processes on Manifolds31 Oct 2024
- 2024On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds28 Oct 2024
- 2024Hyperboloid GPLVM for Discovering Continuous Hierarchies via Nonparametric Estimation22 Oct 2024
- 2024The GeometricKernels Package: Heat and Mat'ern Kernels for Geometric Learning on Manifolds, Meshes, and Graphs10 Jul 2024
- 2023Transfer Learning in Robotics: An Upcoming Breakthrough? A Review of Promises and Challenges29 Nov 2023