Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatches
Not on the map. Why?
Abstract (arXiv)
The ability to automatically recognize a person's behavioral context can contribute to health monitoring, aging care and many other domains. Validating context recognition in-the-wild is crucial to promote practical applications that work in real-life settings. We collected over 300k minutes of sensor data with context labels from 60 subjects. Unlike previous studies, our subjects used their own personal phone, in any way that was convenient to them, and engaged in their routine in their natural environments. Unscripted behavior and unconstrained phone usage resulted in situations that are harder to recognize. We demonstrate how fusion of multi-modal sensors is important for resolving such cases. We present a baseline system, and encourage researchers to use our public dataset to compare methods and improve context recognition in-the-wild.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 11; 2024: 6; 2025: 7; 2026: 6.
41 papers.
Sort:
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
- 2021Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advancescited by 54
- 2022FedStack: Personalized activity monitoring using stacked federated learningcited by 15
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactionscited by 11
- 2022Stop&Hop: Early Classification of Irregular Time Seriescited by 10
- 2023Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcitycited by 9
- 2024TinyLLM: A Framework for Training and Deploying Language Models at the Edge Computerscited by 9
- 2022Human Activity Recognition models using Limited Consumer Device Sensors and Machine Learningcited by 8
- 2025SensorQA: A Question Answering Benchmark for Daily-Life Monitoringcited by 7
- 2022CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulatorcited by 6
- 2023Navigating Alignment for Non-identical Client Class Sets: A Label Name-Anchored Federated Learning Frameworkcited by 6
- 2023(Un)fair devices: Moving beyond AI accuracy in personal sensingcited by 6
29 more
- 2025Scaling laws in wearable human activity recognitioncited by 4
- 2025WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on Smartwatchcited by 4
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Tracescited by 4
- 2024Deep Heterogeneous Contrastive Hyper-Graph Learning for In-the-Wild Context-Aware Human Activity Recognitioncited by 3
- 2025WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatchescited by 3
- 2023Finding Short Signals in Long Irregular Time Series with Continuous-Time Attention Policy Networkscited by 2
- 2024Heterogeneous Hyper-Graph Neural Networks for Context-aware Human Activity Recognitioncited by 2
- 2022VFDS: Variational Foresight Dynamic Selection in Bayesian Neural Networks for Efficient Human Activity Recognitioncited by 1
- 2022UBIWEAR: An end-to-end, data-driven framework for intelligent physical activity prediction to empower mHealth interventionscited by 1
- 2023Undersampling and Cumulative Class Re-decision Methods to Improve Detection of Agitation in People with Dementiacited by 1
- 2023COMPASS: Unsupervised and Online Clustering of Complex Human Activities from Smartphone Sensorscited by 1
- 2024CRoP: Context-wise Robust Static Human-Sensing Personalizationcited by 1
- 2024Adaptive Client Selection with Personalization for Communication Efficient Federated Learningcited by 1
- 2025WHAR Datasets: An Open Source Library for Wearable Human Activity Recognitioncited by 1
- 2022HAR-GCNN: Deep Graph CNNs for Human Activity Recognition From Highly Unlabeled Mobile Sensor Datacited by 0
- 2022On-device modeling of user's social context and familiar places from smartphone-embedded sensor datacited by 0
- 2022Predicting dominant hand from spatiotemporal context varying physiological datacited by 0
- 2023VALERIAN: Invariant Feature Learning for IMU Sensor-based Human Activity Recognition in the Wildcited by 0
- 2023Neuro-Symbolic Approaches for Context-Aware Human Activity Recognitioncited by 0
- 2023DeepStay: Stay Region Extraction from Location Trajectories using Weak Supervisioncited by 0
- 2023MyDigitalFootprint: an extensive context dataset for pervasive computing applications at the edgecited by 0
- 2023CSM-H-R: A Context Modeling Framework in Supporting Reasoning Automation for Interoperable Intelligent Systems and Privacy Protectioncited by 0
- 2024Contrastive Learning with Auxiliary User Detection for Identifying Activitiescited by 0
- 2025Semantically Encoding Activity Labels for Context-Aware Human Activity Recognitioncited by 0
- 2026FED-HARGPT: A Hybrid Centralized-Federated Approach of a Transformer-based Architecture for Human Context Recognitioncited by 0
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognitioncited by 0
- 2026Multimodal Federated Learning under Dual-Axis Modality Missingnesscited by 0
- 2026PrivateHub: Contrastive Diffusion Model for Private Sensor-Intensive Environment Data Generationcited by 0
- 2026Domain Generalization for Smartphone-Based Human Activity Recognition: A Systematic Analysis of Components and Interactionscited by 0
- 2026Domain Generalization for Smartphone-Based Human Activity Recognition: A Systematic Analysis of Components and Interactions14 Sep 2026
- 2026PrivateHub: Contrastive Diffusion Model for Private Sensor-Intensive Environment Data Generation2 Sep 2026
- 2026Multimodal Federated Learning under Dual-Axis Modality Missingness10 Aug 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026FED-HARGPT: A Hybrid Centralized-Federated Approach of a Transformer-based Architecture for Human Context Recognition13 Mar 2026
- 2025WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches5 Sep 2025
- 2025WHAR Datasets: An Open Source Library for Wearable Human Activity Recognition12 Aug 2025
- 2025Semantically Encoding Activity Labels for Context-Aware Human Activity Recognition10 Apr 2025
- 2025WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on Smartwatch9 Feb 2025
- 2025Scaling laws in wearable human activity recognition5 Feb 2025
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactions5 Feb 2025
29 more
- 2025SensorQA: A Question Answering Benchmark for Daily-Life Monitoring9 Jan 2025
- 2024TinyLLM: A Framework for Training and Deploying Language Models at the Edge Computers19 Dec 2024
- 2024Adaptive Client Selection with Personalization for Communication Efficient Federated Learning26 Nov 2024
- 2024Contrastive Learning with Auxiliary User Detection for Identifying Activities21 Oct 2024
- 2024Deep Heterogeneous Contrastive Hyper-Graph Learning for In-the-Wild Context-Aware Human Activity Recognition27 Sep 2024
- 2024CRoP: Context-wise Robust Static Human-Sensing Personalization26 Sep 2024
- 2024Heterogeneous Hyper-Graph Neural Networks for Context-aware Human Activity Recognition26 Sep 2024
- 2023CSM-H-R: A Context Modeling Framework in Supporting Reasoning Automation for Interoperable Intelligent Systems and Privacy Protection21 Aug 2023
- 2023MyDigitalFootprint: an extensive context dataset for pervasive computing applications at the edge28 Jun 2023
- 2023COMPASS: Unsupervised and Online Clustering of Complex Human Activities from Smartphone Sensors27 Jun 2023
- 2023Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcity23 Jun 2023
- 2023Neuro-Symbolic Approaches for Context-Aware Human Activity Recognition8 Jun 2023
- 2023DeepStay: Stay Region Extraction from Location Trajectories using Weak Supervision5 Jun 2023
- 2023(Un)fair devices: Moving beyond AI accuracy in personal sensing27 Mar 2023
- 2023VALERIAN: Invariant Feature Learning for IMU Sensor-based Human Activity Recognition in the Wild3 Mar 2023
- 2023Finding Short Signals in Long Irregular Time Series with Continuous-Time Attention Policy Networks8 Feb 2023
- 2023Undersampling and Cumulative Class Re-decision Methods to Improve Detection of Agitation in People with Dementia7 Feb 2023
- 2023Navigating Alignment for Non-identical Client Class Sets: A Label Name-Anchored Federated Learning Framework1 Jan 2023
- 2022UBIWEAR: An end-to-end, data-driven framework for intelligent physical activity prediction to empower mHealth interventions30 Dec 2022
- 2022Predicting dominant hand from spatiotemporal context varying physiological data8 Dec 2022
- 2022FedStack: Personalized activity monitoring using stacked federated learning27 Sep 2022
- 2022Stop&Hop: Early Classification of Irregular Time Series21 Aug 2022
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlation10 Aug 2022
- 2022On-device modeling of user's social context and familiar places from smartphone-embedded sensor data18 May 2022
- 2022VFDS: Variational Foresight Dynamic Selection in Bayesian Neural Networks for Efficient Human Activity Recognition31 Mar 2022
- 2022HAR-GCNN: Deep Graph CNNs for Human Activity Recognition From Highly Unlabeled Mobile Sensor Data7 Mar 2022
- 2022CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulator21 Feb 2022
- 2022Human Activity Recognition models using Limited Consumer Device Sensors and Machine Learning21 Jan 2022
- 2021Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances31 Oct 2021
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
- 2021Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advancescited by 54
- 2022FedStack: Personalized activity monitoring using stacked federated learningcited by 15
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactionscited by 11
- 2022Stop&Hop: Early Classification of Irregular Time Seriescited by 10
- 2023Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcitycited by 9
- 2024TinyLLM: A Framework for Training and Deploying Language Models at the Edge Computerscited by 9
- 2022Human Activity Recognition models using Limited Consumer Device Sensors and Machine Learningcited by 8
- 2025SensorQA: A Question Answering Benchmark for Daily-Life Monitoringcited by 7
- 2022CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulatorcited by 6
- 2023Navigating Alignment for Non-identical Client Class Sets: A Label Name-Anchored Federated Learning Frameworkcited by 6
- 2023(Un)fair devices: Moving beyond AI accuracy in personal sensingcited by 6
12 most cited of 41 All 41 (JSON)
- 2026Domain Generalization for Smartphone-Based Human Activity Recognition: A Systematic Analysis of Components and Interactions14 Sep 2026
- 2026PrivateHub: Contrastive Diffusion Model for Private Sensor-Intensive Environment Data Generation2 Sep 2026
- 2026Multimodal Federated Learning under Dual-Axis Modality Missingness10 Aug 2026
- 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognition11 Jun 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026FED-HARGPT: A Hybrid Centralized-Federated Approach of a Transformer-based Architecture for Human Context Recognition13 Mar 2026
- 2025WatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches5 Sep 2025
- 2025WHAR Datasets: An Open Source Library for Wearable Human Activity Recognition12 Aug 2025
- 2025Semantically Encoding Activity Labels for Context-Aware Human Activity Recognition10 Apr 2025
- 2025WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on Smartwatch9 Feb 2025
- 2025Scaling laws in wearable human activity recognition5 Feb 2025
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactions5 Feb 2025
12 newest of 41 All 41 (JSON)