mlsanityData to 7 Oct 2026

Survey on Hand Gesture Recognition from Visual Input

arXiv 2501.11992 ↗First posted 21 Jan 2025cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Hand gesture recognition has become an important research area, driven by the growing demand for human-computer interaction in fields such as sign language recognition, virtual and augmented reality, and robotics. Despite the rapid growth of the field, there are few surveys that comprehensively cover recent research developments, available solutions, and benchmark datasets. This survey addresses this gap by examining the latest advancements in hand gesture and 3D hand pose recognition from various types of camera input data including RGB images, depth images, and videos from monocular or multiview cameras, examining the differing methodological requirements of each approach. Furthermore, an overview of widely used datasets is provided, detailing their main characteristics and application domains. Finally, open challenges such as achieving robust recognition in real-world environments, handling occlusions, ensuring generalization across diverse users, and addressing computational efficiency for real-time applications are highlighted to guide future research directions. By synthesizing the objectives, methodologies, and applications of recent studies, this survey offers valuable insights into current trends, challenges, and opportunities for future research in human hand gesture recognition.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 75 of its 257 references that are in the map. First posted on arXiv 21 Jan 2025.

Builds on

75 of 257 references.

References · 75

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  8. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  10. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  11. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  12. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
38 more
  1. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
  2. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  3. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  4. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  5. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  6. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  7. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
  8. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  9. 2018Learning 3D Human Dynamics from Videocited by 315
  10. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  11. 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
  12. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  13. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  14. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  15. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  16. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  17. 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
  18. 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 217
  19. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  20. 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
  21. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  22. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  23. 2019STM: SpatioTemporal and Motion Encoding for Action Recognitioncited by 142
  24. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  25. 2018MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Languagecited by 118
  26. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  27. 2020Multi-Modal Domain Adaptation for Fine-Grained Action Recognitioncited by 115
  28. 2018Hand Pose Estimation via Latent 2.5D Heatmap Regressioncited by 111
  29. 2021Skeleton Aware Multi-modal Sign Language Recognitioncited by 101
  30. 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 90
  31. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  32. 2020AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methodscited by 75
  33. 2016Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Inputcited by 56
  34. 2017Using a single RGB frame for real time 3D hand pose estimation in the wildcited by 39
  35. 20163D Hand Pose Tracking and Estimation Using Stereo Matchingcited by 35
  36. 2019Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networkscited by 30
  37. 2022Consistent 3D Hand Reconstruction in Video via self-supervised Learningcited by 28
  38. 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 4.

10 papers.

  1. 2025TRIFFID: Autonomous Robotic Aid For Increasing First Responders Efficiencycited by 5
  2. 2025RadMamba: Efficient Human Activity Recognition through Radar-based Micro-Doppler-Oriented Mamba State-Space Modelcited by 3
  3. 2025How do Foundation Models Compare to Skeleton-Based Approaches for Gesture Recognition in Human-Robot Interaction?cited by 1
  4. 2025Gestura: A LVLM-Powered System Bridging Motion and Semantics for Real-Time Free-Form Gesture Understandingcited by 1
  5. 2026FR-GESTURE: An RGBD Dataset For Gesture-based Human-Robot Interaction In First Responder Operationscited by 1
  6. 2025Automated Procedural Analysis via Video-Language Models for AI-assisted Nursing Skills Assessmentcited by 0
  7. 2025Neural-HAR: A Dimension-Gated CNN Accelerator for Real-Time Radar Human Activity Recognitioncited by 0
  8. 2026Large-scale Photorealistic Outdoor 3D Scene Reconstruction from UAV Imagery Using Gaussian Splatting Techniquescited by 0
  9. 2026Open-Vocabulary vs Supervised Learning Methods for Post-Disaster Visual Scene Understandingcited by 0
  10. 2026Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generationcited by 0