Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Not on the map. Why?
Abstract (arXiv)
Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human--computer interaction, that measure and improve our daily lives. Many of these applications are made possible by leveraging the rich collection of low-power sensors found in many mobile and wearable devices to perform human activity recognition (HAR). Recently, deep learning has greatly pushed the boundaries of HAR on mobile and wearable devices. This paper systematically categorizes and summarizes existing work that introduces deep learning methods for wearables-based HAR and provides a comprehensive analysis of the current advancements, developing trends, and major challenges. We also present cutting-edge frontiers and future directions for deep learning-based HAR.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 66 of its 345 references that are in the map. First posted on arXiv 31 Oct 2021.
Builds on
66 of 345 references.
References · 66
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2019Invariant Risk Minimizationcited by 1,832
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2017Wasserstein GANcited by 635
- 2018The UCR Time Series Archivecited by 421
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
- 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 213
- 2015Federated Optimization:Distributed Optimization Beyond the Datacentercited by 193
38 more
- 2018Universality of Deep Convolutional Neural Networkscited by 176
- 2017Deep Learning is Robust to Massive Label Noisecited by 164
- 2017Deep Learning for Sensor-based Activity Recognition: A Surveycited by 133
- 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 130
- 2020Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunitiescited by 125
- 2016Mode Regularized Generative Adversarial Networkscited by 123
- 2016Semi-Supervised Learning with Generative Adversarial Networkscited by 103
- 2017Visual to Sound: Generating Natural Sound for Videos in the Wildcited by 98
- 2015Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networkscited by 94
- 2016Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearablescited by 93
- 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
- 2021Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challengescited by 75
- 2018Mobile Sensor Data Anonymizationcited by 70
- 2019On-Device Machine Learning: An Algorithms and Learning Theory Perspectivecited by 63
- 2016UniMiB SHAR: a new dataset for human activity recognition using acceleration data from smartphonescited by 54
- 2018Protecting Sensory Data against Sensitive Inferencescited by 45
- 2016Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatchescited by 41
- 2014TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercisecited by 40
- 2018Data augmentation using synthetic data for time series classification with deep residual networkscited by 38
- 2019Cross-Subject Transfer Learning in Human Activity Recognition Systems using Generative Adversarial Networkscited by 35
- 2018T-CGAN: Conditional Generative Adversarial Network for Data Augmentation in Noisy Time Series with Irregular Samplingcited by 29
- 2018Understanding and Improving Recurrent Networks for Human Activity Recognition by Continuous Attentioncited by 27
- 2017Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensorscited by 24
- 2021Meta-HAR: Federated Representation Learning for Human Activity Recognitioncited by 21
- 2017SenseGen: A Deep Learning Architecture for Synthetic Sensor Data Generationcited by 20
- 2020GANs May Have No Nash Equilibriacited by 20
- 2020Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensorscited by 19
- 2019Domain Adaptation for sEMG-based Gesture Recognition with Recurrent Neural Networkscited by 15
- 2020DanHAR: Dual Attention Network For Multimodal Human Activity Recognition Using Wearable Sensorscited by 14
- 2015Deep Activity Recognition Models with Triaxial Accelerometerscited by 13
- 2018Deep Auto-Set: A Deep Auto-Encoder-Set Network for Activity Recognition Using Wearablescited by 12
- 2019NeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditionscited by 12
- 2016Deep Recurrent Neural Network for Mobile Human Activity Recognition with High Throughputcited by 10
- 2018Online Human Activity Recognition using Low-Power Wearable Devicescited by 10
- 2019Attention-based Convolutional Neural Network for Weakly Labeled Human Activities Recognition with Wearable Sensorscited by 10
- 2021Personalized Semi-Supervised Federated Learning for Human Activity Recognitioncited by 9
- 2018Semi-Supervised Convolutional Neural Networks for Human Activity Recognitioncited by 8
- 2018Distributionally Robust Semi-Supervised Learning for People-Centric Sensingcited by 8
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2022: 3; 2023: 14; 2024: 12; 2025: 13; 2026: 12.
54 papers.
Sort:
By area:
- 2022GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalizationcited by 28
- 2025TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learningcited by 16
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2022Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospectscited by 10
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2023Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracycited by 9
- 2025TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devicescited by 8
- 2023Unleashing the Power of Shared Label Structures for Human Activity Recognitioncited by 6
- 2023Large Scale Foundation Models for Intelligent Manufacturing Applications: A Surveycited by 6
- 2024Diverse Intra- and Inter-Domain Activity Style Fusion for Cross-Person Generalization in Activity Recognitioncited by 6
- 2024Towards LLM-Powered Ambient Sensor Based Multi-Person Human Activity Recognitioncited by 5
- 2024IMUDiffusion: A Diffusion Model for Multivariate Time Series Synthetisation for Inertial Motion Capturing Systemscited by 5
38 more
- 2022Self-Supervised Human Activity Recognition with Localized Time-Frequency Contrastive Representation Learningcited by 4
- 2024A Survey of IMU Based Cross-Modal Transfer Learning in Human Activity Recognitioncited by 4
- 2023cGAN-Based High Dimensional IMU Sensor Data Generation for Enhanced Human Activity Recognition in Therapeutic Activitiescited by 2
- 2024SoK: Behind the Accuracy of Complex Human Activity Recognition Using Deep Learningcited by 2
- 2023Fruit Picker Activity Recognition with Wearable Sensors and Machine Learningcited by 1
- 2023A Survey on Multi-Resident Activity Recognition in Smart Environmentscited by 1
- 2025Improving Out-of-distribution Human Activity Recognition via IMU-Video Cross-modal Representation Learningcited by 1
- 2025Classification of 24-hour movement behaviors from wrist-worn accelerometer data: from handcrafted features to deep learning techniquescited by 1
- 2025Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approachescited by 1
- 2026Graph Vector Field: A Unified Framework for Multimodal Health Risk Assessment from Heterogeneous Wearable and Environmental Data Streamscited by 1
- 2026Prediction of Challenging Behaviors Associated with Profound Autism in a Classroom Setting Using Wearable Sensorscited by 1
- 2023Navigating the reporting guideline environment for computational pathology: A reviewcited by 0
- 2023Sleep Quality Prediction from Wearables using Convolution Neural Networks and Ensemble Learningcited by 0
- 2023rWISDM: Repaired WISDM, a Public Dataset for Human Activity Recognitioncited by 0
- 2023Robust Activity Recognition for Adaptive Worker-Robot Interaction using Transfer Learningcited by 0
- 2023Design of Recognition and Evaluation System for Table Tennis Players' Motor Skills Based on Artificial Intelligencecited by 0
- 2023The Potential of Wearable Sensors for Assessing Patient Acuity in Intensive Care Unit (ICU)cited by 0
- 2023Distributed Agent-Based Collaborative Learning in Cross-Individual Wearable Sensor-Based Human Activity Recognitioncited by 0
- 2024DiTMoS: Delving into Diverse Tiny-Model Selection on Microcontrollerscited by 0
- 2024Wearable-based behaviour interpolation for semi-supervised human activity recognitioncited by 0
- 2024UserBoost: Generating User-specific Synthetic Data for Faster Enrolment into Behavioural Biometric Systemscited by 0
- 2024Leveraging Hybrid Intelligence Towards Sustainable and Energy-Efficient Machine Learningcited by 0
- 2024Raising the Bar(ometer): Identifying a User's Stair and Lift Usage Through Wearable Sensor Data Analysiscited by 0
- 2024WearableMil: An End-to-End Framework for Military Activity Recognition and Performance Monitoringcited by 0
- 2025In Shift and In Variance: Assessing the Robustness of HAR Deep Learning Models against Variabilitycited by 0
- 2025Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Datasetcited by 0
- 2025Confidence-driven Gradient Modulation for Multimodal Human Activity Recognition: A Dynamic Contrastive Dual-Path Learning Approachcited by 0
- 2025Reinforcement Learning Driven Generalizable Feature Representation for Cross-User Activity Recognitioncited by 0
- 2025OVGrasp: Open-Vocabulary Grasping Assistance via Multimodal Intent Detectioncited by 0
- 2025Artificial Intelligence-driven Intelligent Wearable Systems: A full-stack Integration from Material Design to Personalized Interactioncited by 0
- 2025MMA: A Momentum Mamba Architecture for Human Activity Recognition with Inertial Sensorscited by 0
- 2025DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learningcited by 0
- 2026Integrating Temporal Context into Streaming Data for Human Activity Recognition in Smart Homecited by 0
- 2026Summary of the Unusual Activity Recognition Challenge for Developmental Disability Supportcited by 0
- 2026BabyMamba-HAR: Lightweight Selective State Space Models for Efficient Human Activity Recognition on Resource Constrained Devicescited by 0
- 2026Resource-Efficient Gesture Recognition through Convexified Attentioncited by 0
- 2026Modular Retrieval-Augmented Generalization for Human Action Recognitioncited by 0
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognitioncited by 0
50 most cited of 54 All 54 (JSON)
- 2026Deep Multimodal Wearable Sensor Fusion for Detection of Body-Focused Repetitive Behaviors10 Aug 2026
- 2026Joint-Embedding Predictive Architecture for Sensor-based Activity Recognition17 Jul 2026
- 2026A Comparative Study of Deep Learning Architectures for Multi-Horizon Behavioural Forecasting for Mobile Health12 Jun 2026
- 2026Personal Care Utility: Health as Everyday Infrastructure12 Jun 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026Prediction of Challenging Behaviors Associated with Profound Autism in a Classroom Setting Using Wearable Sensors17 May 2026
- 2026Modular Retrieval-Augmented Generalization for Human Action Recognition28 Apr 2026
- 2026Graph Vector Field: A Unified Framework for Multimodal Health Risk Assessment from Heterogeneous Wearable and Environmental Data Streams30 Mar 2026
- 2026Resource-Efficient Gesture Recognition through Convexified Attention13 Feb 2026
- 2026BabyMamba-HAR: Lightweight Selective State Space Models for Efficient Human Activity Recognition on Resource Constrained Devices10 Feb 2026
- 2026Summary of the Unusual Activity Recognition Challenge for Developmental Disability Support21 Jan 2026
- 2026Integrating Temporal Context into Streaming Data for Human Activity Recognition in Smart Home9 Jan 2026
38 more
- 2025DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning23 Dec 2025
- 2025Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches15 Dec 2025
- 2025MMA: A Momentum Mamba Architecture for Human Activity Recognition with Inertial Sensors26 Nov 2025
- 2025Artificial Intelligence-driven Intelligent Wearable Systems: A full-stack Integration from Material Design to Personalized Interaction17 Nov 2025
- 2025Classification of 24-hour movement behaviors from wrist-worn accelerometer data: from handcrafted features to deep learning techniques10 Sep 2025
- 2025OVGrasp: Open-Vocabulary Grasping Assistance via Multimodal Intent Detection4 Sep 2025
- 2025Reinforcement Learning Driven Generalizable Feature Representation for Cross-User Activity Recognition31 Aug 2025
- 2025Improving Out-of-distribution Human Activity Recognition via IMU-Video Cross-modal Representation Learning17 Jul 2025
- 2025TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devices10 Jul 2025
- 2025Confidence-driven Gradient Modulation for Multimodal Human Activity Recognition: A Dynamic Contrastive Dual-Path Learning Approach3 Jul 2025
- 2025TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learning16 Jun 2025
- 2025Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset27 May 2025
- 2025In Shift and In Variance: Assessing the Robustness of HAR Deep Learning Models against Variability14 Mar 2025
- 2024IMUDiffusion: A Diffusion Model for Multivariate Time Series Synthetisation for Inertial Motion Capturing Systems5 Nov 2024
- 2024WearableMil: An End-to-End Framework for Military Activity Recognition and Performance Monitoring7 Oct 2024
- 2024Raising the Bar(ometer): Identifying a User's Stair and Lift Usage Through Wearable Sensor Data Analysis18 Sep 2024
- 2024Leveraging Hybrid Intelligence Towards Sustainable and Energy-Efficient Machine Learning15 Jul 2024
- 2024UserBoost: Generating User-specific Synthetic Data for Faster Enrolment into Behavioural Biometric Systems12 Jul 2024
- 2024Towards LLM-Powered Ambient Sensor Based Multi-Person Human Activity Recognition25 Jun 2024
- 2024Diverse Intra- and Inter-Domain Activity Style Fusion for Cross-Person Generalization in Activity Recognition7 Jun 2024
- 2024Wearable-based behaviour interpolation for semi-supervised human activity recognition24 May 2024
- 2024SoK: Behind the Accuracy of Complex Human Activity Recognition Using Deep Learning25 Apr 2024
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognition14 Apr 2024
- 2024A Survey of IMU Based Cross-Modal Transfer Learning in Human Activity Recognition17 Mar 2024
- 2024DiTMoS: Delving into Diverse Tiny-Model Selection on Microcontrollers14 Mar 2024
- 2023Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey11 Dec 2023
- 2023Distributed Agent-Based Collaborative Learning in Cross-Individual Wearable Sensor-Based Human Activity Recognition6 Nov 2023
- 2023The Potential of Wearable Sensors for Assessing Patient Acuity in Intensive Care Unit (ICU)3 Nov 2023
- 2023Design of Recognition and Evaluation System for Table Tennis Players' Motor Skills Based on Artificial Intelligence4 Sep 2023
- 2023Robust Activity Recognition for Adaptive Worker-Robot Interaction using Transfer Learning28 Aug 2023
- 2023Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracy13 Jun 2023
- 2023rWISDM: Repaired WISDM, a Public Dataset for Human Activity Recognition17 May 2023
- 2023A Survey on Multi-Resident Activity Recognition in Smart Environments24 Apr 2023
- 2023Fruit Picker Activity Recognition with Wearable Sensors and Machine Learning20 Apr 2023
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review14 Mar 2023
- 2023Sleep Quality Prediction from Wearables using Convolution Neural Networks and Ensemble Learning8 Mar 2023
- 2023cGAN-Based High Dimensional IMU Sensor Data Generation for Enhanced Human Activity Recognition in Therapeutic Activities16 Feb 2023
- 2023Navigating the reporting guideline environment for computational pathology: A review3 Jan 2023
50 newest of 54 All 54 (JSON)
- 2022GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalizationcited by 28
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2022Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospectscited by 10
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2023Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracycited by 9
- 2025TinierHAR: Towards Ultra-Lightweight Deep Learning Models for Efficient Human Activity Recognition on Edge Devicescited by 8
- 2023Unleashing the Power of Shared Label Structures for Human Activity Recognitioncited by 6
- 2023Large Scale Foundation Models for Intelligent Manufacturing Applications: A Surveycited by 6
- 2024Diverse Intra- and Inter-Domain Activity Style Fusion for Cross-Person Generalization in Activity Recognitioncited by 6
- 2024Towards LLM-Powered Ambient Sensor Based Multi-Person Human Activity Recognitioncited by 5
- 2022Self-Supervised Human Activity Recognition with Localized Time-Frequency Contrastive Representation Learningcited by 4
- 2024A Survey of IMU Based Cross-Modal Transfer Learning in Human Activity Recognitioncited by 4
12 most cited of 50 All 50 (JSON)
- 2026Deep Multimodal Wearable Sensor Fusion for Detection of Body-Focused Repetitive Behaviors10 Aug 2026
- 2026Joint-Embedding Predictive Architecture for Sensor-based Activity Recognition17 Jul 2026
- 2026A Comparative Study of Deep Learning Architectures for Multi-Horizon Behavioural Forecasting for Mobile Health12 Jun 2026
- 2026Personal Care Utility: Health as Everyday Infrastructure12 Jun 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026Prediction of Challenging Behaviors Associated with Profound Autism in a Classroom Setting Using Wearable Sensors17 May 2026
- 2026Modular Retrieval-Augmented Generalization for Human Action Recognition28 Apr 2026
- 2026Graph Vector Field: A Unified Framework for Multimodal Health Risk Assessment from Heterogeneous Wearable and Environmental Data Streams30 Mar 2026
- 2026Resource-Efficient Gesture Recognition through Convexified Attention13 Feb 2026
- 2026Summary of the Unusual Activity Recognition Challenge for Developmental Disability Support21 Jan 2026
- 2026Integrating Temporal Context into Streaming Data for Human Activity Recognition in Smart Home9 Jan 2026
- 2025DETACH : Decomposed Spatio-Temporal Alignment for Exocentric Video and Ambient Sensors with Staged Learning23 Dec 2025
12 newest of 50 All 50 (JSON)