mlsanityData to 7 Oct 2026

A Survey on Human Action Recognition

arXiv 2301.06082 ↗First posted 20 Dec 2022cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human Action Recognition (HAR), one of the most important tasks in computer vision, has developed rapidly in the past decade and has a wide range of applications in health monitoring, intelligent surveillance, virtual reality, human computer interaction and so on. Human actions can be represented by a wide variety of modalities, such as RGB-D cameras, audio, inertial sensors,etc. Consequently, in addition to the mainstream single modality based HAR approaches, more and more research is devoted to the multimodal domain due to the complementary properties between multimodal data. In this paper, we present a survey of HAR methods in recent years according to the different input modalities. Meanwhile, considering that most of the recent surveys on HAR focus on the third perspective, while this survey aims to provide a more comprehensive introduction to HAR novices and researchers, we therefore also investigate the actions recognition methods from the first perspective in recent years. Finally, we give a brief introduction about the benchmark HAR datasets and show the performance comparison of different methods on these datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 89 of its 167 references that are in the map. First posted on arXiv 20 Dec 2022.

Builds on

89 of 167 references.

References · 89

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  5. 2017The Kinetics Human Action Video Datasetcited by 1,894
  6. 2018SlowFast Networks for Video Recognitioncited by 1,862
  7. 2021ViViT: A Video Vision Transformercited by 1,610
  8. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  9. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  10. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  11. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
  12. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
38 more
  1. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  2. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
  3. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
  4. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  5. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  6. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
  7. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  8. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  9. 2020Rescaling Egocentric Visioncited by 529
  10. 2014Long-term Recurrent Convolutional Networks for Visual Recognition and Descriptioncited by 483
  11. 2016Convolutional Two-Stream Network Fusion for Video Action Recognitioncited by 384
  12. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
  13. 2018A Short Note about Kinetics-600cited by 331
  14. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 308
  15. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
  16. 2021Video Transformer Networkcited by 271
  17. 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
  18. 2015Beyond Short Snippets: Deep Networks for Video Classificationcited by 233
  19. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  20. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  21. 2019EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognitioncited by 226
  22. 2022Multiview Transformers for Video Recognitioncited by 148
  23. 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 146
  24. 2020Audiovisual SlowFast Networks for Video Recognitioncited by 144
  25. 2018Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNNcited by 142
  26. 2019Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognitioncited by 135
  27. 2021RegionViT: Regional-to-Local Attention for Vision Transformerscited by 126
  28. 2020Rolling-Unrolling LSTMs for Action Anticipation from First-Person Videocited by 119
  29. 2018Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregationcited by 106
  30. 2018Actor and Observer: Joint Modeling of First and Third-Person Videoscited by 102
  31. 2021Constructing Stronger and Faster Baselines for Skeleton-based Action Recognitioncited by 87
  32. 2018View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognitioncited by 84
  33. 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 68
  34. 2017Multi-Context Attention for Human Pose Estimationcited by 66
  35. 2016VideoLSTM Convolves, Attends and Flows for Action Recognitioncited by 60
  36. 2015Action Recognition with Trajectory-Pooled Deep-Convolutional Descriptorscited by 58
  37. 2018LSTA: Long Short-Term Attention for Egocentric Action Recognitioncited by 57
  38. 2017Attentional Pooling for Action Recognitioncited by 54

50 most cited of 89 All 89 (JSON)

Built on by

Not cited yet.