Expressive Keypoints for Skeleton-based Action Recognition via Skeleton Transformation
Not on the map. Why?
Abstract (arXiv)
In the realm of skeleton-based action recognition, the traditional methods which rely on coarse body keypoints fall short of capturing subtle human actions. In this work, we propose Expressive Keypoints that incorporates hand and foot details to form a fine-grained skeletal representation, improving the discriminative ability for existing models in discerning intricate actions. To efficiently model Expressive Keypoints, the Skeleton Transformation strategy is presented to gradually downsample the keypoints and prioritize prominent joints by allocating the importance weights. Additionally, a plug-and-play Instance Pooling module is exploited to extend our approach to multi-person scenarios without surging computation costs. Extensive experimental results over seven datasets present the superiority of our method compared to the state-of-the-art for skeleton-based human action recognition. Code is available at https://github.com/YijieYang23/SkeleT-GCN.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 26 Jun 2024.
Builds on
36 of 52 references.
References · 36
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015Fast R-CNNcited by 2,930
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
24 more
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
- 2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognitioncited by 339
- 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2020Whole-Body Human Pose Estimation in the Wildcited by 178
- 2014Cross-view Action Modeling, Learning and Recognitioncited by 134
- 2018Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregationcited by 106
- 2019Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networkscited by 103
- 2017PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understandingcited by 101
- 2022Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 85
- 2022PYSKL: Towards Good Practices for Skeleton Action Recognitioncited by 83
- 2021Skeleton-Contrastive 3D Action Representation Learningcited by 76
- 2022PSTNet: Point Spatio-Temporal Convolution on Point Cloud Sequencescited by 68
- 2020A Survey on 3D Skeleton-Based Action Recognition Using Learning Methodcited by 46
- 2022STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognitioncited by 43
- 2019SkeleMotion: A New Representation of Skeleton Joint Sequences Based on Motion Information for 3D Action Recognitioncited by 42
- 2021VPN++: Rethinking Video-Pose embeddings for understanding Activities of Daily Livingcited by 35
- 2018Glimpse Clouds: Human Activity Recognition from Unstructured Feature Pointscited by 33
- 2022DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action Recognitioncited by 26
- 2019Skeleton Image Representation for 3D Action Recognition based on Tree Structure and Reference Jointscited by 25
- 2023Unified Keypoint-based Action Recognition Framework via Structured Keypoint Poolingcited by 19
- 2021Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognitioncited by 13
- 2017Skeleton Boxes: Solving skeleton based action detection with a single deep convolutional neural networkcited by 7
- 2019Skeleton-based Action Recognition of People Handling Objectscited by 7
Built on by
Citing papers per year: 2025: 5; 2026: 1.
6 papers.
- 2025Body-Hand Modality Expertized Networks with Cross-attention for Fine-grained Skeleton Action Recognitioncited by 3
- 2025Evolving Skeletons: Motion Dynamics in Action Recognitioncited by 1
- 2025AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attentioncited by 0
- 2025Label-Efficient Skeleton-based Recognition with Stable-Invertible Graph Convolutional Networkscited by 0
- 2025Active Learning for GCN-based Action Recognitioncited by 0
- 2026BHaRNet: Reliability-Aware Body-Hand Modality Expertized Networks for Fine-grained Skeleton Action Recognitioncited by 0
- 2026BHaRNet: Reliability-Aware Body-Hand Modality Expertized Networks for Fine-grained Skeleton Action Recognition1 Jan 2026
- 2025Active Learning for GCN-based Action Recognition26 Nov 2025
- 2025Label-Efficient Skeleton-based Recognition with Stable-Invertible Graph Convolutional Networks21 Nov 2025
- 2025AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attention27 Sep 2025
- 2025Body-Hand Modality Expertized Networks with Cross-attention for Fine-grained Skeleton Action Recognition19 Mar 2025
- 2025Evolving Skeletons: Motion Dynamics in Action Recognition5 Jan 2025