Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook
Not on the map. Why?
Abstract (arXiv)
Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneity, and weak generalization across users, devices, and contexts. Foundation models, which are generally pretrained at scale using self-supervised and multimodal learning, offer a unifying paradigm to address these challenges by learning reusable, adaptable representations for activity understanding. This survey synthesizes emerging foundation models for sensor-based HAR. We first clarify foundational concepts, definitions, and evaluation criteria, then organize existing work using a lifecycle-oriented taxonomy spanning input design, pretraining, adaptation, and utilization. Rather than enumerating individual models, we analyze recurring design patterns and trade-offs across nine technical axes, including modality scope, tokenization, architectures, learning paradigms, adaptation mechanisms, and deployment settings. From this synthesis, we identify three dominant development trajectories: (1) HAR-specific foundation models trained from scratch on large sensor corpora, (2) adaptation of general time-series or multimodal foundation models to sensor-based HAR, and (3) integration of large language models for reasoning, annotation, and human-AI interaction. We conclude by highlighting open challenges in data curation, multimodal alignment, personalization, privacy, and responsible deployment, and outline directions toward general-purpose, interpretable, and human-centered foundation models for activity understanding. A complete, continuously updated index of papers and models is available in our companion repository: https://github.com/zhaxidele/Foundation-Models-Defining-A-New-Era-In-Human-Activity-Recognition.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Apr 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wildcited by 1
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understandingcited by 1
- 2026BayaHAR: Lightweight Bayesian Few-Shot User Adaptation for On-Device Personalized Human Activity Recognitioncited by 0
- 2026Foundation models for movement data: Are they ready for prime-time?cited by 0
- 2026EdgeHAR: An Edge-Native Compact Sensor Foundation Model for Human Activity Recognitioncited by 0
- 2026You Don't Need To Train: Agentic Heuristic Learning Studio for Executable Human Activity Recognitioncited by 0
- 2026More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jevcited by 0
- 2026More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jev28 Sep 2026
- 2026You Don't Need To Train: Agentic Heuristic Learning Studio for Executable Human Activity Recognition13 Sep 2026
- 2026EdgeHAR: An Edge-Native Compact Sensor Foundation Model for Human Activity Recognition13 Sep 2026
- 2026Foundation models for movement data: Are they ready for prime-time?13 Aug 2026
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understanding31 Jul 2026
- 2026BayaHAR: Lightweight Bayesian Few-Shot User Adaptation for On-Device Personalized Human Activity Recognition3 Jun 2026
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wild21 May 2026