Towards Generalizable Human Activity Recognition: A Survey
Not on the map. Why?
Abstract (arXiv)
As a critical component of Wearable AI, IMU-based Human Activity Recognition (HAR) has attracted increasing attention from both academia and industry in recent years. Although HAR performance has improved considerably in specific scenarios, its generalization capability remains a key barrier to widespread real-world adoption. For example, domain shifts caused by variations in users, sensor positions, or environments can significantly decrease the performance in practice. As a result, in this survey, we explore the rapidly evolving field of IMU-based generalizable HAR, reviewing 229 research papers alongside 25 publicly available datasets to provide a broad and insightful overview. We first present the background and overall framework of IMU-based HAR tasks, as well as the generalization-oriented training settings. Then, we categorize representative methodologies from two perspectives: (i) model-centric approaches, including pre-training method, end-to-end method, and large language model (LLM)-based learning method; and (ii) data-centric approaches, including multi-modal learning and data augmentation techniques. In addition, we summarize widely used datasets in this field, as well as relevant tools and benchmarks. Building on these methodological advances, the broad applicability of IMU-based HAR is also reviewed and discussed. Finally, we discuss persistent challenges (e.g., data scarcity, efficient training, and reliable evaluation) and also outline future directions for HAR, including the adoption of foundation and large language models, physics-informed and context-aware reasoning, generative modeling, and resource-efficient training and inference. The complete list of this survey is available at https://github.com/rh20624/Awesome-IMU-Sensing, which will be updated continuously.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 57 of its 194 references that are in the map. First posted on arXiv 17 Aug 2025.
Builds on
57 of 194 references.
References · 57
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Generative Adversarial Networkscited by 5,603
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2020Federated Continual Learning with Weighted Inter-client Transfercited by 158
- 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 98
- 2016Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearablescited by 93
- 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
- 2022Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Datacited by 71
- 2022Assessing the State of Self-Supervised Human Activity Recognition using Wearablescited by 63
38 more
- 2017Neural Ranking Models with Weak Supervisioncited by 61
- 2024Scaling Wearable Foundation Modelscited by 57
- 2020Contrastive Predictive Coding for Human Activity Recognitioncited by 54
- 2024HARGPT: Are LLMs Zero-Shot Human Activity Recognizers?cited by 52
- 2022Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformercited by 47
- 2018Protecting Sensory Data against Sensitive Inferencescited by 45
- 2025SensorLM: Learning the Language of Wearable Sensorscited by 44
- 2020Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligencecited by 39
- 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
- 2023FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Spacecited by 31
- 2023WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognitioncited by 30
- 2022Semantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognitioncited by 28
- 2022Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Datacited by 27
- 2024UniMTS: Unified Pre-training for Motion Time Seriescited by 22
- 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 20
- 2021A Survey of Privacy Vulnerabilities of Mobile Device Sensorscited by 18
- 2023Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity Recognitioncited by 18
- 2023CroSSL: Cross-modal Self-Supervised Learning for Time-series through Latent Maskingcited by 18
- 2022Domain Generalization for Activity Recognition via Adaptive Feature Fusioncited by 16
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognitioncited by 15
- 2024Transfer Learning in Human Activity Recognition: A Surveycited by 14
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Taskcited by 14
- 2020Incremental Real-Time Personalization in Human Activity Recognition Using Domain Adaptive Batch Normalizationcited by 13
- 2025ZARA: Training-Free Motion Time-Series Reasoning via Evidence-Grounded LLM Agentscited by 13
- 2018Cross-position Activity Recognition with Stratified Transfer Learningcited by 11
- 2020Leveraging Activity Recognition to Enable Protective Behavior Detection in Continuous Datacited by 11
- 2024MESEN: Exploit Multimodal Data to Design Unimodal Human Activity Recognition with Few Labelscited by 11
- 2023Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearablescited by 10
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2024iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognitioncited by 9
- 2024Machine Learning Techniques for Sensor-based Human Activity Recognition with Data Heterogeneity -- A Reviewcited by 9
- 2024PRIMUS: Pretraining IMU Encoders with Multimodal Self-Supervisioncited by 9
- 2023HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial Sensingcited by 8
- 2017Progress Estimation and Phase Detection for Sequential Processescited by 4
- 2025Leveraging the Spatial Hierarchy: Coarse-to-fine Trajectory Generation via Cascaded Hybrid Diffusioncited by 4
- 2020Learning Generalizable Physiological Representations from Large-scale Wearable Datacited by 3
- 2021How You Move Your Head Tells What You Do: Self-supervised Video Representation Learning with Egocentric Cameras and IMU Sensorscited by 3
- 2024GPS-IMU Sensor Fusion for Reliable Autonomous Vehicle Position Estimationcited by 3
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognitioncited by 1
- 2026Prediction of Challenging Behaviors Associated with Profound Autism in a Classroom Setting Using Wearable Sensorscited by 1
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wildcited by 1
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understandingcited by 0
- 2026RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohortscited by 0
- 2026Domain Generalization for Smartphone-Based Human Activity Recognition: A Systematic Analysis of Components and Interactionscited by 0
- 2026Domain Generalization for Smartphone-Based Human Activity Recognition: A Systematic Analysis of Components and Interactions14 Sep 2026
- 2026RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohorts8 Sep 2026
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understanding31 Jul 2026
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wild21 May 2026
- 2026Prediction of Challenging Behaviors Associated with Profound Autism in a Classroom Setting Using Wearable Sensors17 May 2026
- 2026BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognition8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2023Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition
- 2026Modular Retrieval-Augmented Generalization for Human Action Recognition
- 2025RAG-HAR: Retrieval Augmented Generation-based Human Activity Recognition
- 2025On-device Large Multi-modal Agent for Human Activity Recognition
- 2026RAG-HAR+: Towards Cost-Efficient LLM-Based Human Activity Recognition for Edge Deployment
- 2021AHAR: Adaptive CNN for Energy-efficient Human Activity Recognition in Low-power Edge Devices
- 2026SensingAgents: A Multi-Agent Collaborative Framework for Robust IMU Activity Recognition
- 2026WS-IMUBench: Can Weakly Supervised Methods from Audio, Image, and Video Be Adapted for IMU-based Temporal Action Localization?