A neural network based on SPD manifold learning for skeleton-based hand gesture recognition
Not on the map. Why?
Abstract (arXiv)
This paper proposes a new neural network based on SPD manifold learning for skeleton-based hand gesture recognition. Given the stream of hand's joint positions, our approach combines two aggregation processes on respectively spatial and temporal domains. The pipeline of our network architecture consists in three main stages. The first stage is based on a convolutional layer to increase the discriminative power of learned features. The second stage relies on different architectures for spatial and temporal Gaussian aggregation of joint features. The third stage learns a final SPD matrix from skeletal data. A new type of layer is proposed for the third stage, based on a variant of stochastic gradient descent on Stiefel manifolds. The proposed network is validated on two challenging datasets and shows state-of-the-art accuracies on both datasets.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 4; 2023: 13; 2024: 8; 2025: 6; 2026: 5.
46 papers.
Sort:
By area:
- 2021GeomNet: A Neural Network Based on Riemannian Geometries of SPD Matrix Space and Cholesky Space for 3D Skeleton-Based Interaction Recognitioncited by 27
- 2021Transductive Few-Shot Classification on the Oblique Manifoldcited by 23
- 2021Vector-valued Distance and Gyrocalculus on the Space of Symmetric Positive Definite Matricescited by 22
- 2023Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approachcited by 18
- 2021Decoupling and Recoupling Spatiotemporal Representation for RGB-D-based Motion Recognitioncited by 13
- 2023SPD-DDPM: Denoising Diffusion Probabilistic Models in the Symmetric Positive Definite Spacecited by 13
- 2024Matrix Manifold Neural Networks++cited by 13
- 2022Multi-manifold Attention for Vision Transformerscited by 12
- 2024In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognitioncited by 12
- 2023Riemannian Multinomial Logistics Regression for SPD Neural Networkscited by 11
- 2021A Two-stream Neural Network for Pose-based Hand Gesture Recognitioncited by 10
- 2021Deep Efficient Continuous Manifold Learning for Time Series Modelingcited by 10
34 more
- 2023Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matricescited by 10
- 2021HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognitioncited by 6
- 2023Ultra-Range Gesture Recognition using a Web-Camera in Human-Robot Interactioncited by 6
- 2024Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learningcited by 5
- 2026Neural Networks on Symmetric Spaces of Noncompact Typecited by 5
- 2023Riemannian Self-Attention Mechanism for SPD Networkscited by 4
- 2024Schur's Positive-Definite Network: Deep Learning in the SPD cone with structurecited by 3
- 2023OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Visioncited by 2
- 2024Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNNcited by 2
- 2025Action Recognition in Real-World Ambient Assisted Living Environmentcited by 2
- 2025Data-Free Class-Incremental Gesture Recognition with Prototype-Guided Pseudo Feature Replaycited by 2
- 2025DFNN: A Deep Fr'echet Neural Network Framework for Learning Metric-Space-Valued Responsescited by 2
- 2021Fast Monocular Hand Pose Estimation on Embedded Systemscited by 1
- 2021Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygienecited by 1
- 2022DreamNet: A Deep Riemannian Network based on SPD Manifold Learning for Visual Classificationcited by 1
- 2022Rieoptax: Riemannian Optimization in JAXcited by 1
- 2023mSPD-NN: A Geometrically Aware Neural Framework for Biomarker Discovery from Functional Connectomics Manifoldscited by 1
- 2024Boosting Gesture Recognition with an Automatic Gesture Annotation Frameworkcited by 1
- 2024SHARP: Segmentation of Hands and Arms by Range using Pseudo-Depth for Enhanced Egocentric 3D Hand Pose Estimation and Action Recognitioncited by 1
- 2025Online hand gesture recognition using Continual Graph Transformerscited by 1
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimationcited by 1
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 0
- 2022Literature on Hand GESTURE Recognition using Graph based methodscited by 0
- 2023Faster Riemannian Newton-type Optimization by Subsampling and Cubic Regularizationcited by 0
- 2023Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruningcited by 0
- 2023Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Posecited by 0
- 2023Miniaturized Graph Convolutional Networks with Topologically Consistent Pruningcited by 0
- 2023One-Shot Multi-Rate Pruning of Graph Convolutional Networkscited by 0
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networkscited by 0
- 2025Accurate online action and gesture recognition system using detectors and Deep SPD Siamese Networkscited by 0
- 2025Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Networkcited by 0
- 2026E2E-GNet: An End-to-End Skeleton-based Geometric Deep Neural Network for Human Motion Recognitioncited by 0
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detectioncited by 0
- 2026Towards Robust EEG Decoding Based on Riemannian Self-Attentioncited by 0
- 2026Towards Robust EEG Decoding Based on Riemannian Self-Attention24 Jun 2026
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation20 Mar 2026
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection20 Mar 2026
- 2026E2E-GNet: An End-to-End Skeleton-based Geometric Deep Neural Network for Human Motion Recognition3 Mar 2026
- 2026Neural Networks on Symmetric Spaces of Noncompact Type3 Jan 2026
- 2025Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Network9 Nov 2025
- 2025Accurate online action and gesture recognition system using detectors and Deep SPD Siamese Networks7 Nov 2025
- 2025DFNN: A Deep Fr'echet Neural Network Framework for Learning Metric-Space-Valued Responses20 Oct 2025
- 2025Data-Free Class-Incremental Gesture Recognition with Prototype-Guided Pseudo Feature Replay26 May 2025
- 2025Action Recognition in Real-World Ambient Assisted Living Environment29 Mar 2025
- 2025Online hand gesture recognition using Continual Graph Transformers20 Feb 2025
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks18 Oct 2024
34 more
- 2024Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning17 Oct 2024
- 2024SHARP: Segmentation of Hands and Arms by Range using Pseudo-Depth for Enhanced Egocentric 3D Hand Pose Estimation and Action Recognition19 Aug 2024
- 2024Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNN21 Jun 2024
- 2024Schur's Positive-Definite Network: Deep Learning in the SPD cone with structure13 Jun 2024
- 2024Matrix Manifold Neural Networks++29 May 2024
- 2024In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition14 Apr 2024
- 2024Boosting Gesture Recognition with an Automatic Gesture Annotation Framework20 Jan 2024
- 2023One-Shot Multi-Rate Pruning of Graph Convolutional Networks29 Dec 2023
- 2023SPD-DDPM: Denoising Diffusion Probabilistic Models in the Symmetric Positive Definite Space13 Dec 2023
- 2023Riemannian Self-Attention Mechanism for SPD Networks28 Nov 2023
- 2023Ultra-Range Gesture Recognition using a Web-Camera in Human-Robot Interaction26 Nov 2023
- 2023OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Vision20 Aug 2023
- 2023Miniaturized Graph Convolutional Networks with Topologically Consistent Pruning30 Jun 2023
- 2023Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matrices24 Jun 2023
- 2023Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Pose8 Jun 2023
- 2023Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruning30 May 2023
- 2023Riemannian Multinomial Logistics Regression for SPD Neural Networks18 May 2023
- 2023Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach8 May 2023
- 2023mSPD-NN: A Geometrically Aware Neural Framework for Biomarker Discovery from Functional Connectomics Manifolds27 Mar 2023
- 2023Faster Riemannian Newton-type Optimization by Subsampling and Cubic Regularization22 Feb 2023
- 2022Rieoptax: Riemannian Optimization in JAX10 Oct 2022
- 2022Multi-manifold Attention for Vision Transformers18 Jul 2022
- 2022Literature on Hand GESTURE Recognition using Graph based methods1 Jul 2022
- 2022DreamNet: A Deep Riemannian Network based on SPD Manifold Learning for Visual Classification16 Jun 2022
- 2021Decoupling and Recoupling Spatiotemporal Representation for RGB-D-based Motion Recognition16 Dec 2021
- 2021Deep Efficient Continuous Manifold Learning for Time Series Modeling3 Dec 2021
- 2021GeomNet: A Neural Network Based on Riemannian Geometries of SPD Matrix Space and Cholesky Space for 3D Skeleton-Based Interaction Recognition25 Nov 2021
- 2021Vector-valued Distance and Gyrocalculus on the Space of Symmetric Positive Definite Matrices26 Oct 2021
- 2021Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene7 Sep 2021
- 2021Transductive Few-Shot Classification on the Oblique Manifold9 Aug 2021
- 2021HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition25 Jun 2021
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition12 Apr 2021
- 2021Fast Monocular Hand Pose Estimation on Embedded Systems14 Feb 2021
- 2021A Two-stream Neural Network for Pose-based Hand Gesture Recognition22 Jan 2021
- 2021GeomNet: A Neural Network Based on Riemannian Geometries of SPD Matrix Space and Cholesky Space for 3D Skeleton-Based Interaction Recognitioncited by 27
- 2021Transductive Few-Shot Classification on the Oblique Manifoldcited by 23
- 2021Vector-valued Distance and Gyrocalculus on the Space of Symmetric Positive Definite Matricescited by 22
- 2023Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approachcited by 18
- 2021Decoupling and Recoupling Spatiotemporal Representation for RGB-D-based Motion Recognitioncited by 13
- 2024Matrix Manifold Neural Networks++cited by 13
- 2022Multi-manifold Attention for Vision Transformerscited by 12
- 2024In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognitioncited by 12
- 2023Riemannian Multinomial Logistics Regression for SPD Neural Networkscited by 11
- 2021A Two-stream Neural Network for Pose-based Hand Gesture Recognitioncited by 10
- 2021Deep Efficient Continuous Manifold Learning for Time Series Modelingcited by 10
- 2023Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matricescited by 10
12 most cited of 45 All 45 (JSON)
- 2026Towards Robust EEG Decoding Based on Riemannian Self-Attention24 Jun 2026
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation20 Mar 2026
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection20 Mar 2026
- 2026E2E-GNet: An End-to-End Skeleton-based Geometric Deep Neural Network for Human Motion Recognition3 Mar 2026
- 2026Neural Networks on Symmetric Spaces of Noncompact Type3 Jan 2026
- 2025Learning Topology-Driven Multi-Subspace Fusion for Grassmannian Deep Network9 Nov 2025
- 2025Accurate online action and gesture recognition system using detectors and Deep SPD Siamese Networks7 Nov 2025
- 2025DFNN: A Deep Fr'echet Neural Network Framework for Learning Metric-Space-Valued Responses20 Oct 2025
- 2025Data-Free Class-Incremental Gesture Recognition with Prototype-Guided Pseudo Feature Replay26 May 2025
- 2025Action Recognition in Real-World Ambient Assisted Living Environment29 Mar 2025
- 2025Online hand gesture recognition using Continual Graph Transformers20 Feb 2025
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks18 Oct 2024
12 newest of 45 All 45 (JSON)