Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Recently, Convolutional Neural Networks (ConvNets) have shown promising performances in many computer vision tasks, especially image-based recognition. How to effectively use ConvNets for video-based recognition is still an open problem. In this paper, we propose a compact, effective yet simple method to encode spatio-temporal information carried in 3D skeleton sequences into multiple 2D images, referred to as Joint Trajectory Maps (JTM), and ConvNets are adopted to exploit the discriminative features for real-time human action recognition. The proposed method has been evaluated on three public benchmarks, i.e., MSRC-12 Kinect gesture dataset (MSRC-12), G3D dataset and UTD multimodal human action dataset (UTD-MHAD) and achieved the state-of-the-art results.
Key facts. Cited by 32 papers in the map (data through 13 Oct 2026). First posted on arXiv 8 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 10; 2024: 7; 2025: 5; 2026: 3.
32 papers.
Sort:
By area:
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
- 2022SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognitioncited by 29
- 2022Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognitioncited by 18
- 2023Pyramid Self-attention Polymerization Learning for Semi-supervised Skeleton-based Action Recognitioncited by 11
- 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learningcited by 11
- 2024Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithmscited by 11
- 2023Skeleton-based Action Recognition through Contrasting Two-Stream Spatial-Temporal Networkscited by 9
- 2024Skeleton-Based Human Action Recognition with Noisy Labelscited by 8
- 2023STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognitioncited by 7
- 2025Trokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognitioncited by 7
- 2021A Central Difference Graph Convolutional Operator for Skeleton-Based Action Recognitioncited by 6
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
20 more
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
- 20253D Skeleton-Based Action Recognition: A Reviewcited by 6
- 2025Towards Robust and Realistic Human Pose Estimation via WiFi Signalscited by 5
- 20253D Plant Root Skeleton Detection and Extractioncited by 5
- 2023Skeleton-based Human Action Recognition via Convolutional Neural Networks (CNN)cited by 4
- 2024Deep video representation learning: a surveycited by 4
- 2022Transformers in Action Recognition: A Review on Temporal Modelingcited by 3
- 2026Universal Skeleton Understanding via Differentiable Rendering and MLLMscited by 3
- 2022Collective Intelligent Strategy for Improved Segmentation of COVID-19 from CTcited by 1
- 2024Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercisescited by 1
- 2025Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorderscited by 1
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 0
- 2023Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruningcited by 0
- 2023Miniaturized Graph Convolutional Networks with Topologically Consistent Pruningcited by 0
- 2023SkelVIT: Consensus of Vision Transformers for a Lightweight Skeleton-Based Action Recognition Systemcited by 0
- 2023Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Artcited by 0
- 2023One-Shot Multi-Rate Pruning of Graph Convolutional Networkscited by 0
- 2024Unsupervised Motion Retargeting for Human-Robot Imitationcited by 0
- 2026Lens Privacy Sealing: A New Benchmark and Method for Physical Privacy-Preserving Action Recognitioncited by 0
- 2026DiMoP: Diffusion-Driven Motion Representation Learning With Frame-Level Pseudo-Classification for Skeleton-Based Action Recognitioncited by 0
- 2026DiMoP: Diffusion-Driven Motion Representation Learning With Frame-Level Pseudo-Classification for Skeleton-Based Action Recognition28 Sep 2026
- 2026Lens Privacy Sealing: A New Benchmark and Method for Physical Privacy-Preserving Action Recognition19 May 2026
- 2026Universal Skeleton Understanding via Differentiable Rendering and MLLMs18 Mar 2026
- 20253D Plant Root Skeleton Detection and Extraction11 Aug 2025
- 2025Trokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognition5 Aug 2025
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorders13 Apr 2025
- 2025Towards Robust and Realistic Human Pose Estimation via WiFi Signals16 Jan 2025
- 2024Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithms19 Aug 2024
- 2024Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercises5 Aug 2024
- 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learning31 May 2024
- 2024Deep video representation learning: a survey10 May 2024
20 more
- 2024Skeleton-Based Human Action Recognition with Noisy Labels15 Mar 2024
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognition14 Mar 2024
- 2024Unsupervised Motion Retargeting for Human-Robot Imitation18 Jan 2024
- 2023One-Shot Multi-Rate Pruning of Graph Convolutional Networks29 Dec 2023
- 2023Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Art21 Nov 2023
- 2023SkelVIT: Consensus of Vision Transformers for a Lightweight Skeleton-Based Action Recognition System14 Nov 2023
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey19 Oct 2023
- 2023Miniaturized Graph Convolutional Networks with Topologically Consistent Pruning30 Jun 2023
- 2023Budget-Aware Graph Convolutional Network Design using Probabilistic Magnitude Pruning30 May 2023
- 2023STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition31 Mar 2023
- 2023Pyramid Self-attention Polymerization Learning for Semi-supervised Skeleton-based Action Recognition5 Feb 2023
- 2023Skeleton-based Human Action Recognition via Convolutional Neural Networks (CNN)31 Jan 2023
- 2023Skeleton-based Action Recognition through Contrasting Two-Stream Spatial-Temporal Networks27 Jan 2023
- 2022Transformers in Action Recognition: A Review on Temporal Modeling29 Dec 2022
- 2022Collective Intelligent Strategy for Improved Segmentation of COVID-19 from CT23 Dec 2022
- 2022Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognition6 Oct 2022
- 2022SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognition1 Sep 2022
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognition17 Aug 2022
- 2021A Central Difference Graph Convolutional Operator for Skeleton-Based Action Recognition13 Nov 2021
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition12 Apr 2021
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
- 2022SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognitioncited by 29
- 2022Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognitioncited by 18
- 2023Pyramid Self-attention Polymerization Learning for Semi-supervised Skeleton-based Action Recognitioncited by 11
- 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learningcited by 11
- 2024Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithmscited by 11
- 2023Skeleton-based Action Recognition through Contrasting Two-Stream Spatial-Temporal Networkscited by 9
- 2024Skeleton-Based Human Action Recognition with Noisy Labelscited by 8
- 2023STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognitioncited by 7
- 2025Trokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognitioncited by 7
- 2021A Central Difference Graph Convolutional Operator for Skeleton-Based Action Recognitioncited by 6
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
12 most cited of 31 All 31 (JSON)
- 2026DiMoP: Diffusion-Driven Motion Representation Learning With Frame-Level Pseudo-Classification for Skeleton-Based Action Recognition28 Sep 2026
- 2026Lens Privacy Sealing: A New Benchmark and Method for Physical Privacy-Preserving Action Recognition19 May 2026
- 20253D Plant Root Skeleton Detection and Extraction11 Aug 2025
- 2025Trokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognition5 Aug 2025
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorders13 Apr 2025
- 2025Towards Robust and Realistic Human Pose Estimation via WiFi Signals16 Jan 2025
- 2024Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithms19 Aug 2024
- 2024Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercises5 Aug 2024
- 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learning31 May 2024
- 2024Deep video representation learning: a survey10 May 2024
- 2024Skeleton-Based Human Action Recognition with Noisy Labels15 Mar 2024
12 newest of 31 All 31 (JSON)