mlsanityData to 14 Oct 2026

Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task

arXiv 2411.14452 ↗First posted 11 Nov 2024eess.SP cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

In the many years since the inception of wearable sensor-based Human Activity Recognition (HAR), a wide variety of methods have been introduced and evaluated for their ability to recognize activities. Substantial gains have been made since the days of hand-crafting heuristics as features, yet, progress has seemingly stalled on many popular benchmarks, with performance falling short of what may be considered 'sufficient'-- despite the increase in computational power and scale of sensor data, as well as rising complexity in techniques being employed. The HAR community approaches a new paradigm shift, this time incorporating world knowledge from foundational models. In this paper, we take stock of sensor-based HAR -- surveying it from its beginnings to the current state of the field, and charting its future. This is accompanied by a hands-on tutorial, through which we guide practitioners in developing HAR systems for real-world application scenarios. We provide a compendium for novices and experts alike, of methods that aim at finally solving the activity recognition problem.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 104 of its 227 references that are in the map. First posted on arXiv 11 Nov 2024.

Builds on

104 of 227 references.

References · 104

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  6. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  7. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  8. 2023GPT-4 Technical Reportcited by 18,396
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  10. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  11. 2020Denoising Diffusion Implicit Modelscited by 9,781
  12. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
38 more
  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  8. 2023Mistral 7Bcited by 3,164
  9. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  10. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
  12. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  13. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  14. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  15. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  16. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  17. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  18. 2024Chronos: Learning the Language of Time Seriescited by 759
  19. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
  20. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  21. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  22. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  23. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  24. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  25. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
  26. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  27. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  28. 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 436
  29. 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 339
  30. 2021Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Losscited by 313
  31. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  32. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  33. 2022Masked Autoencoders that Listencited by 273
  34. 2023Improving CLIP Training with Language Rewritescited by 217
  35. 2021Wav2CLIP: Learning Robust Audio Representations From CLIPcited by 213
  36. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
  37. 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
  38. 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 131

50 most cited of 104 All 104 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 10.

15 papers.

Sort:

  1. 2025COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognitioncited by 9
  2. 2025Towards Generalizable Human Activity Recognition: A Surveycited by 6
  3. 2025Initial Findings on Sensor based Open Vocabulary Activity Recognition via Text Embedding Inversioncited by 2
  4. 2025CPEP: Contrastive Pose-EMG Pre-training Enhances Gesture Generalization on EMG Signalscited by 2
  5. 2026Bio-Inspired Self-Supervised Learning for Wrist-worn Accelerometer Datacited by 2
  6. 2026BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognitioncited by 2
  7. 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wildcited by 1
  8. 2026Joint-Embedding Predictive Architecture for Sensor-based Activity Recognitioncited by 1
  9. 2025LiDAR-based Human Activity Recognition through Laplacian Spectral Analysiscited by 0
  10. 2026Towards Green Wearable Computing: A Physics-Aware Spiking Neural Network for Energy-Efficient IMU-based Human Activity Recognitioncited by 0
  11. 2026Triple Spectral Fusion for Sensor-based Human Activity Recognitioncited by 0
  12. 2026VSMP-IMU: Video-Grounded Semantic Motion Programs for Sensor-Aware Synthetic IMU Generationcited by 0
3 more
  1. 2026Rotation-Invariant Multi-IMU Activity Recognition under Independent Per-Location Orientation Shiftscited by 0
  2. 2026When Temporal Perturbations Act Like Sensor Biases: Label-Free Auditing of Wearable Activity Recognizerscited by 0
  3. 2026Variable Input Masked Autoencoders for Wrist-Worn Accelerometrycited by 0