# Vision and Inertial Sensing Fusion for Human Action Recognition : A Review

arXiv: https://arxiv.org/abs/2008.00380 · HTML: https://mlsanity.com/paper/2008.00380/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Aug 2020.

## Built on by (most cited first, 10 of 10)

- [EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding](https://mlsanity.com/paper/2301.02217/) (2023)
- [DeepOIS: Gyroscope-Guided Deep Optical Image Stabilizer Compensation](https://mlsanity.com/paper/2101.11183/) (2021)
- [A Survey of IMU Based Cross-Modal Transfer Learning in Human Activity Recognition](https://mlsanity.com/paper/2403.15444/) (2024)
- [Transformers in Action Recognition: A Review on Temporal Modeling](https://mlsanity.com/paper/2302.01921/) (2022)
- [Multitasking Deep Learning Model for Detection of Five Stages of Diabetic Retinopathy](https://mlsanity.com/paper/2103.04207/) (2021)
- [Efficient and Accurate Skeleton-Based Two-Person Interaction Recognition Using Inter- and Intra-body Graphs](https://mlsanity.com/paper/2207.12648/) (2022)
- [C3T: Cross-modal Transfer Through Time for Sensor-based Human Activity Recognition](https://mlsanity.com/paper/2407.16803/) (2024)
- [Inertial Hallucinations -- When Wearable Inertial Devices Start Seeing Things](https://mlsanity.com/paper/2207.06789/) (2022)
- [Multi-View Conformal Learning for Heterogeneous Sensor Fusion](https://mlsanity.com/paper/2402.12307/) (2024)
- [Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection](https://mlsanity.com/paper/2603.17069/) (2026)

## Abstract (arXiv)

Human action recognition is used in many applications such as video surveillance, human computer interaction, assistive living, and gaming. Many papers have appeared in the literature showing that the fusion of vision and inertial sensing improves recognition accuracies compared to the situations when each sensing modality is used individually. This paper provides a survey of the papers in which vision and inertial sensing are used simultaneously within a fusion framework in order to perform human action recognition. The surveyed papers are categorized in terms of fusion approaches, features, classifiers, as well as multimodality datasets considered. Challenges as well as possible future directions are also stated for deploying the fusion of these two sensing modalities under realistic conditions.