# Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer

arXiv: https://arxiv.org/abs/2412.18321 · HTML: https://mlsanity.com/paper/2412.18321/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 28 references that are in the map.
- First posted on arXiv 24 Dec 2024.

## Builds on (most cited first, 17 of 17)

- [Transforming Multidimensional Time Series into Interpretable Event Sequences for Advanced Data Mining](https://mlsanity.com/paper/2409.14327/) (2024)
- [Self-Supervised Graph Neural Networks for Enhanced Feature Extraction in Heterogeneous Information Networks](https://mlsanity.com/paper/2410.17617/) (2024)
- [Harnessing LLMs for API Interactions: A Framework for Classification and Synthetic Data Generation](https://mlsanity.com/paper/2409.11703/) (2024)
- [Emotion-Aware Interaction Design in Intelligent User Interface Using Multi-Modal Deep Learning](https://mlsanity.com/paper/2411.06326/) (2024)
- [Adaptive Optimization for Enhanced Efficiency in Large-Scale Language Model Training](https://mlsanity.com/paper/2412.04718/) (2024)
- [Metric Learning for Tag Recommendation: Tackling Data Sparsity and Cold Start Issues](https://mlsanity.com/paper/2411.06374/) (2024)
- [Efficient and Aesthetic UI Design with a Deep Learning-Based Interface Generation Tree Algorithm](https://mlsanity.com/paper/2410.17586/) (2024)
- [LoRA-LiteE: A Computationally Efficient Framework for Chatbot Preference-Tuning](https://mlsanity.com/paper/2411.09947/) (2024)
- [Comprehensive Evaluation of Multimodal AI Models in Medical Imaging Diagnosis: From Data Augmentation to Preference-Based Comparison](https://mlsanity.com/paper/2412.05536/) (2024)
- [Adaptive Cache Management for Complex Storage Systems Using CNN-LSTM-Based Spatiotemporal Prediction](https://mlsanity.com/paper/2411.12161/) (2024)
- [Enhancing Few-Shot Learning with Integrated Data and GAN Model Approaches](https://mlsanity.com/paper/2411.16567/) (2024)
- [An Automated Data Mining Framework Using Autoencoders for Feature Extraction and Dimensionality Reduction](https://mlsanity.com/paper/2412.02211/) (2024)
- [Leveraging Semi-Supervised Learning to Enhance Data Mining for Image Classification under Limited Labeled Data](https://mlsanity.com/paper/2411.18622/) (2024)
- [Accurate Medical Named Entity Recognition Through Specialized NLP Models](https://mlsanity.com/paper/2412.08255/) (2024)
- [Enhancing Recommendation Systems with GNNs and Addressing Over-Smoothing](https://mlsanity.com/paper/2412.03097/) (2024)
- [Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models](https://mlsanity.com/paper/2412.06249/) (2024)
- [Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNN](https://mlsanity.com/paper/2406.15003/) (2024)

## Built on by (most cited first, 3 of 3)

- [Graph Neural Network-Driven Hierarchical Mining for Complex Imbalanced Data](https://mlsanity.com/paper/2502.03803/) (2025)
- [Optimized Unet with Attention Mechanism for Multi-Scale Semantic Segmentation](https://mlsanity.com/paper/2502.03813/) (2025)
- [Multi-Level Attention and Contrastive Learning for Enhanced Text Classification with an Optimized Transformer](https://mlsanity.com/paper/2501.13467/) (2025)

## Abstract (arXiv)

This study mainly explores the application of natural gesture recognition based on computer vision in human-computer interaction, aiming to improve the fluency and naturalness of human-computer interaction through gesture recognition technology. In the fields of virtual reality, augmented reality and smart home, traditional input methods have gradually failed to meet the needs of users for interactive experience. As an intuitive and convenient interaction method, gestures have received more and more attention. This paper proposes a gesture recognition method based on a three-dimensional hand skeleton model. By simulating the three-dimensional spatial distribution of hand joints, a simplified hand skeleton structure is constructed. By connecting the palm and each finger joint, a dynamic and static gesture model of the hand is formed, which further improves the accuracy and efficiency of gesture recognition. Experimental results show that this method can effectively recognize various gestures and maintain high recognition accuracy and real-time response capabilities in different environments. In addition, combined with multimodal technologies such as eye tracking, the intelligence level of the gesture recognition system can be further improved, bringing a richer and more intuitive user experience. In the future, with the continuous development of computer vision, deep learning and multimodal interaction technology, natural interaction based on gestures will play an important role in a wider range of application scenarios and promote revolutionary progress in human-computer interaction.