mlsanityData to 7 Oct 2026

Non-stationary BERT: Exploring Augmented IMU Data For Robust Human Activity Recognition

arXiv 2409.16730 ↗First posted 25 Sep 2024cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human Activity Recognition (HAR) has gained great attention from researchers due to the popularity of mobile devices and the need to observe users' daily activity data for better human-computer interaction. In this work, we collect a human activity recognition dataset called OPPOHAR consisting of phone IMU data. To facilitate the employment of HAR system in mobile phone and to achieve user-specific activity recognition, we propose a novel light-weight network called Non-stationary BERT with a two-stage training method. We also propose a simple yet effective data augmentation method to explore the deeper relationship between the accelerator and gyroscope data from the IMU. The network achieves the state-of-the-art performance testing on various activity recognition datasets and the data augmentation method demonstrates its wide applicability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

11 of 32 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  6. 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
  7. 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
  8. 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
  9. 2019A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devicescited by 7
  10. 2023GBT: Two-stage transformer framework for non-stationary time series forecastingcited by 7
  11. 2020Data Augmentation of IMU Signals and Evaluation via a Semi-Supervised Classification of Driving Behaviorcited by 3

Built on by

Not cited yet.