Continuous Human Action Recognition for Human-Machine Interaction: A Review
Not on the map. Why?
Abstract (arXiv)
With advances in data-driven machine learning research, a wide variety of prediction models have been proposed to capture spatio-temporal features for the analysis of video streams. Recognising actions and detecting action transitions within an input video are challenging but necessary tasks for applications that require real-time human-machine interaction. By reviewing a large body of recent related work in the literature, we thoroughly analyse, explain and compare action segmentation methods and provide details on the feature extraction and learning strategies that are used on most state-of-the-art methods. We cover the impact of the performance of object detection and tracking techniques on human action segmentation methodologies. We investigate the application of such models to real-world scenarios and discuss several limitations and key research directions towards improving interpretability, generalisation, optimisation and deployment.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 134 of its 198 references that are in the map. First posted on arXiv 26 Feb 2022.
Builds on
134 of 198 references.
References · 134
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
38 more
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2015Fast R-CNNcited by 2,930
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
- 2019Objects as Pointscited by 1,172
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2018Path Aggregation Network for Instance Segmentationcited by 796
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
50 most cited of 134 All 134 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 2; 2026: 3.
10 papers.
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2022Vision-Based Activity Recognition in Children with Autism-Related Behaviorscited by 7
- 2023Deep Learning Approaches for Seizure Video Analysis: A Reviewcited by 6
- 20253D Skeleton-Based Action Recognition: A Reviewcited by 6
- 2024An Animation-based Augmentation Approach for Action Recognition from Discontinuous Videocited by 2
- 2024ContextDet: Temporal Action Detection with Adaptive Context Aggregationcited by 2
- 2025Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysiscited by 2
- 2026On the Evaluation Protocol of Gesture Recognition for UAV-based Rescue Operation based on Deep Learning: A Subject-Independence Perspectivecited by 1
- 2026SCALE: Semantic- and Confidence-Aware Conditional Variational Autoencoder for Zero-shot Skeleton-based Action Recognitioncited by 1
- 2026Can Large Language Models Detect Methodological Flaws? Evidence from Gesture Recognition for UAV-Based Rescue Operation Based on Deep Learningcited by 0
- 2026SCALE: Semantic- and Confidence-Aware Conditional Variational Autoencoder for Zero-shot Skeleton-based Action Recognition2 Apr 2026
- 2026Can Large Language Models Detect Methodological Flaws? Evidence from Gesture Recognition for UAV-Based Rescue Operation Based on Deep Learning23 Mar 2026
- 2026On the Evaluation Protocol of Gesture Recognition for UAV-based Rescue Operation based on Deep Learning: A Subject-Independence Perspective19 Feb 2026
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysis1 Mar 2025
- 2024ContextDet: Temporal Action Detection with Adaptive Context Aggregation20 Oct 2024
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognition14 Apr 2024
- 2024An Animation-based Augmentation Approach for Action Recognition from Discontinuous Video10 Apr 2024
- 2023Deep Learning Approaches for Seizure Video Analysis: A Review18 Dec 2023
- 2022Vision-Based Activity Recognition in Children with Autism-Related Behaviors8 Aug 2022