Deep Learning for Sensor-based Activity Recognition: A Survey
Not on the map. Why?
Abstract (arXiv)
Sensor-based activity recognition seeks the profound high-level knowledge about human activities from multitudes of low-level sensor readings. Conventional pattern recognition approaches have made tremendous progress in the past years. However, those methods often heavily rely on heuristic hand-crafted feature extraction, which could hinder their generalization performance. Additionally, existing methods are undermined for unsupervised and incremental learning tasks. Recently, the recent advancement of deep learning makes it possible to perform automatic high-level feature extraction thus achieves promising performance in many areas. Since then, deep learning based methods have been widely adopted for the sensor-based activity recognition tasks. This paper surveys the recent advance of deep learning based sensor-based activity recognition. We summarize existing literature from three aspects: sensor modality, deep model, and application. We also present detailed insights on existing work and propose grand challenges for future research.
Key facts. Cited by 133 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 31; 2023: 32; 2024: 17; 2025: 14; 2026: 14.
133 papers.
Sort:
By area:
- 2021Adaptive Inference through Early-Exit Networks: Design, Challenges and Directionscited by 74
- 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2021Deep Gait Recognition: A Surveycited by 54
- 2021Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advancescited by 54
- 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 49
- 2021Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signalscited by 41
- 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
- 2022MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcarecited by 36
- 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
- 2021A Federated Learning Aggregation Algorithm for Pervasive Computing: Evaluation and Comparisoncited by 31
- 2022Out-of-Distribution Representation Learning for Time Series Classificationcited by 30
38 more
- 2022Semantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognitioncited by 28
- 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
- 2022Graph Anomaly Detection with Graph Neural Networks: Current Status and Challengescited by 23
- 2021Cross-domain Activity Recognition via Substructural Optimal Transportcited by 21
- 2021Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysiscited by 21
- 2021Meta-HAR: Federated Representation Learning for Human Activity Recognitioncited by 21
- 2021A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learningcited by 21
- 2022Domain Generalization for Activity Recognition via Adaptive Feature Fusioncited by 16
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognitioncited by 15
- 2022Continual Learning for Multivariate Time Series Tasks with Variable Input Dimensionscited by 14
- 2024Initial Investigation of Kolmogorov-Arnold Networks (KANs) as Feature Extractors for IMU Based Human Activity Recognitioncited by 12
- 2021An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligencecited by 11
- 2021Adversarial Deep Feature Extraction Network for User Independent Human Activity Recognitioncited by 10
- 2022Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospectscited by 10
- 2023Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearablescited by 10
- 2023Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcitycited by 9
- 2024Machine Learning Techniques for Sensor-based Human Activity Recognition with Data Heterogeneity -- A Reviewcited by 9
- 2024Using Large Language Models to Compare Explainable Models for Smart Home Human Activity Recognitioncited by 9
- 2022Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognitioncited by 8
- 2022A Close Look into Human Activity Recognition Models using Deep Learningcited by 8
- 2021Knowing when we do not know: Bayesian continual learning for sensing-based analysis taskscited by 7
- 2022SemiPFL: Personalized Semi-Supervised Federated Learning Framework for Edge Intelligencecited by 7
- 2022End-to-End Signal Classification in Signed Cumulative Distribution Transform Spacecited by 7
- 2022Self-supervised Pretraining and Transfer Learning Enable Flu and COVID-19 Predictions in Small Mobile Sensing Datasetscited by 7
- 2022TrafficCAM: A Versatile Dataset for Traffic Flow Segmentationcited by 7
- 2021Time series forecasting of new cases and new deaths rate for COVID-19 using deep learning methodscited by 6
- 2022CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulatorcited by 6
- 2023Worker Activity Recognition in Manufacturing Line Using Near-body Electric Fieldcited by 6
- 2022Efficient Deep Clustering of Human Activities and How to Improve Evaluationcited by 5
- 2024Structural Knowledge Informed Continual Multivariate Time Series Forecastingcited by 5
- 2024Generalizable Sensor-Based Activity Recognition via Categorical Concept Invariant Learningcited by 5
- 2022YONO: Modeling Multiple Heterogeneous Neural Networks on Microcontrollerscited by 4
- 2023A Multi-Task Deep Learning Approach for Sensor-based Human Activity Recognition and Segmentationcited by 4
- 2024Explaining Time Series Classification Predictions via Causal Attributionscited by 4
- 2021Interpretable Deep Learning for the Remote Characterisation of Ambulation in Multiple Sclerosis using Smartphonescited by 3
- 2022Benchmarking Conventional Vision Models on Neuromorphic Fall Detection and Action Recognition Datasetcited by 3
- 2022Two ways to make your robot proactive: reasoning about human intentions, or reasoning about possible futurescited by 3
- 2022BSDGAN: Balancing Sensor Data Generative Adversarial Networks for Human Activity Recognitioncited by 3
50 most cited of 133 All 133 (JSON)
- 2026RAST: Resolution-Aware Privileged Structure Transfer for Low-Resolution Audio Activity Recognition30 Sep 2026
- 2026More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jev28 Sep 2026
- 2026Metacognitive Selective Ensemble for Mobile Systems25 Sep 2026
- 2026TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognition16 Aug 2026
- 2026A Comparison of Fusion Techniques for Multi-Modal Human Activity Recognition on the HARMES Dataset26 Jun 2026
- 2026From Compression to Deployment: Real-Time and Energy-Efficient FastGRNN on Ultra-Constrained Microcontrollers15 Jun 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition29 May 2026
- 2026Efficient and Adaptive Human Activity Recognition via LLM Backbones12 May 2026
- 2026Smartwatch-Based Sitting Time Estimation in Real-World Office Settings9 Apr 2026
- 2026SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition27 Mar 2026
- 2026CFD-HAR: User-controllable Privacy through Conditional Feature Disentanglement12 Mar 2026
38 more
- 2026Auto-Augmentation Contrastive Learning for Wearable-based Human Activity Recognition30 Jan 2026
- 2026ConSensus: Multi-Agent Collaboration for Multimodal Sensing10 Jan 2026
- 2025Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches15 Dec 2025
- 2025HAROOD: A Benchmark for Out-of-distribution Generalization in Sensor-based Human Activity Recognition11 Dec 2025
- 2025CACARA: Cross-Modal Alignment Leveraging a Text-Centric Approach for Cost-Effective Multimodal and Multilingual Learning29 Nov 2025
- 2025MMA: A Momentum Mamba Architecture for Human Activity Recognition with Inertial Sensors26 Nov 2025
- 2025Fusing Biomechanical and Spatio-Temporal Features for Fall Prediction: Characterizing and Mitigating the Simulation-to-Reality Gap18 Nov 2025
- 2025Ensemble Distribution Distillation for Self-Supervised Human Activity Recognition10 Sep 2025
- 2025A fine-grained attention and geometric correspondence model for musculoskeletal risk classification in athletes using multimodal visual and skeletal features7 Sep 2025
- 2025Deconfounding Causal Inference through Two-Branch Framework with Early-Forking for Sensor-Based Cross-Domain Activity Recognition5 Jul 2025
- 2025Confidence-driven Gradient Modulation for Multimodal Human Activity Recognition: A Dynamic Contrastive Dual-Path Learning Approach3 Jul 2025
- 2025Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset27 May 2025
- 2025Personalized Control for Lower Limb Prosthesis Using Kolmogorov-Arnold Networks14 May 2025
- 2025Redundant feature screening method for human activity recognition based on attention purification mechanism30 Mar 2025
- 2025Process Optimization and Deployment for Sensor-Based Human Activity Recognition Based on Deep Learning22 Mar 2025
- 2025Domain Generalization for Improved Human Activity Recognition in Office Space Videos Using Adaptive Pre-processing16 Mar 2025
- 2024Generalizable Sensor-Based Activity Recognition via Categorical Concept Invariant Learning18 Dec 2024
- 2024A State-of-the-Art Review of Computational Models for Analyzing Longitudinal Wearable Sensor Data in Healthcare31 Jul 2024
- 2024Consistency Based Weakly Self-Supervised Learning for Human Activity Recognition with Wearables29 Jul 2024
- 2024Using Large Language Models to Compare Explainable Models for Smart Home Human Activity Recognition24 Jul 2024
- 2024SwishReLU: A Unified Approach to Activation Functions for Enhanced Deep Neural Networks Performance11 Jul 2024
- 2024Topological Persistence Guided Knowledge Distillation for Wearable Sensor Data7 Jul 2024
- 2024Initial Investigation of Kolmogorov-Arnold Networks (KANs) as Feature Extractors for IMU Based Human Activity Recognition16 Jun 2024
- 2024Explaining Time Series Classification Predictions via Causal Attributions24 May 2024
- 2024OMuSense-23: A Multimodal Dataset for Contactless Breathing Pattern Recognition and Biometric Analysis22 May 2024
- 2024Beyond Isolated Frames: Enhancing Sensor-Based Human Activity Recognition through Intra- and Inter-Frame Attention21 May 2024
- 2024Meta-Decomposition: Dynamic Segmentation Approach Selection in IoT-based Activity Recognition17 Apr 2024
- 2024Machine Learning Techniques for Sensor-based Human Activity Recognition with Data Heterogeneity -- A Review12 Mar 2024
- 2024ContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models11 Mar 2024
- 2024Value Prediction for Spatiotemporal Gait Data Using Deep Learning29 Feb 2024
- 2024Structural Knowledge Informed Continual Multivariate Time Series Forecasting20 Feb 2024
- 2024Self-supervised New Activity Detection in Sensor-based Smart Environments17 Jan 2024
- 2024DOO-RE: A dataset of ambient sensors in a meeting room for activity recognition17 Jan 2024
- 2023Non-contact Multimodal Indoor Human Monitoring Systems: A Survey11 Dec 2023
- 2023A Video-Based Activity Classification of Human Pickers in Agriculture17 Nov 2023
- 2023Know Thy Neighbors: A Graph Based Approach for Effective Sensor-Based Human Activity Recognition in Smart Homes16 Nov 2023
- 2023Game Theory Solutions in Sensor-Based Human Activity Recognition: A Review9 Nov 2023
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognition28 Oct 2023
50 newest of 133 All 133 (JSON)
- 2026ConSensus: Multi-Agent Collaboration for Multimodal Sensing10 Jan 2026
- 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2021Deep Gait Recognition: A Surveycited by 54
- 2021Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advancescited by 54
- 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 49
- 2021Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signalscited by 41
- 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
- 2022MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcarecited by 36
- 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
- 2021A Federated Learning Aggregation Algorithm for Pervasive Computing: Evaluation and Comparisoncited by 31
- 2022Out-of-Distribution Representation Learning for Time Series Classificationcited by 30
- 2022Semantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognitioncited by 28
12 most cited of 130 All 130 (JSON)
- 2026RAST: Resolution-Aware Privileged Structure Transfer for Low-Resolution Audio Activity Recognition30 Sep 2026
- 2026More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jev28 Sep 2026
- 2026Metacognitive Selective Ensemble for Mobile Systems25 Sep 2026
- 2026TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognition16 Aug 2026
- 2026A Comparison of Fusion Techniques for Multi-Modal Human Activity Recognition on the HARMES Dataset26 Jun 2026
- 2026From Compression to Deployment: Real-Time and Energy-Efficient FastGRNN on Ultra-Constrained Microcontrollers15 Jun 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition29 May 2026
- 2026Efficient and Adaptive Human Activity Recognition via LLM Backbones12 May 2026
- 2026Smartwatch-Based Sitting Time Estimation in Real-World Office Settings9 Apr 2026
- 2026SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition27 Mar 2026
- 2026CFD-HAR: User-controllable Privacy through Conditional Feature Disentanglement12 Mar 2026
12 newest of 130 All 130 (JSON)