mlsanityData to 7 Oct 2026

WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition

arXiv 2304.05088 ↗First posted 11 Apr 2023cs.CV cs.HCcited by 30

Not on the map. Why?

Abstract (arXiv)

Research has shown the complementarity of camera- and inertial-based data for modeling human activities, yet datasets with both egocentric video and inertial-based sensor data remain scarce. In this paper, we introduce WEAR, an outdoor sports dataset for both vision- and inertial-based human activity recognition (HAR). Data from 22 participants performing a total of 18 different workout activities was collected with synchronized inertial (acceleration) and camera (egocentric video) data recorded at 11 different outside locations. WEAR provides a challenging prediction scenario in changing outdoor environments using a sensor placement, in line with recent trends in real-world applications. Benchmark results show that through our sensor placement, each modality interestingly offers complementary strengths and weaknesses in their prediction performance. Further, in light of the recent success of single-stage Temporal Action Localization (TAL) models, we demonstrate their versatility of not only being trained using visual data, but also using raw inertial data and being capable to fuse both modalities by means of simple concatenation. The dataset and code to reproduce experiments is publicly available via: mariusbock.github.io/wear/.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 49 of its 89 references that are in the map. First posted on arXiv 11 Apr 2023.

Builds on

49 of 89 references.

References · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  6. 2017The Kinetics Human Action Video Datasetcited by 1,894
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  8. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  9. 2020Rescaling Egocentric Visioncited by 529
  10. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
  11. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  12. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
37 more
  1. 2021ActionCLIP: A New Paradigm for Video Action Recognitioncited by 317
  2. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  3. 2019G-TAD: Sub-Graph Localization for Temporal Action Detectioncited by 248
  4. 2019Graph Convolutional Networks for Temporal Action Localizationcited by 208
  5. 2021Anticipative Video Transformercited by 197
  6. 2015Visualizing and Understanding Recurrent Networkscited by 158
  7. 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
  8. 2021End-to-end Temporal Action Detection with Transformercited by 150
  9. 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
  10. 2019Gaussian Temporal Awareness Networks for Action Localizationcited by 135
  11. 2021Relaxed Transformer Decoders for Direct Action Proposal Generationcited by 116
  12. 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
  13. 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
  14. 2016Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearablescited by 93
  15. 2019Fast Learning of Temporal Action Proposal via Dense Boundary Generatorcited by 89
  16. 2020Boundary Content Graph Neural Network for Temporal Action Proposal Generationcited by 88
  17. 2022TALLFormer: Temporal Action Localization with a Long-memory Transformercited by 78
  18. 2021Enriching Local and Global Contexts for Temporal Action Localizationcited by 64
  19. 2017Ensembles of Deep LSTM Learners for Activity Recognition using Wearablescited by 61
  20. 2020Multi-shot Temporal Event Localization: a Benchmarkcited by 52
  21. 2022ReAct: Temporal Action Detection with Relational Queriescited by 47
  22. 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40
  23. 2021Class Semantics-based Attention for Action Detectioncited by 36
  24. 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
  25. 2018On Attention Models for Human Activity Recognitioncited by 34
  26. 2021Improving Deep Learning for HAR with shallow LSTMscited by 30
  27. 2022Proposal-Free Temporal Action Detection via Global Segmentation Mask Learningcited by 29
  28. 2022BasicTAD: an Astounding RGB-Only Baseline for Temporal Action Detectioncited by 28
  29. 2023Towards Continual Egocentric Activity Recognition: A Multi-modal Egocentric Activity Dataset for Continual Learningcited by 26
  30. 2020Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensorscited by 19
  31. 2019Scale Matters: Temporal Scale Aggregation Network for Precise Action Localization in Untrimmed Videoscited by 17
  32. 2022Predicting the Next Action by Modeling the Abstract Goalcited by 14
  33. 2022Multimodal Transformer for Nursing Activity Recognitioncited by 12
  34. 2017Anticipating Daily Intention using On-Wrist Motion Triggered Sensingcited by 8
  35. 2016Egocentric Activity Recognition with Multimodal Fisher Vectorcited by 5
  36. 2019A Multi-Media Exchange Format for Time-Series Dataset Curationcited by 1
  37. 2022MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognitioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 12; 2026: 14.

30 papers.

Sort:

By area:

  1. 2025EgoLife: Towards Egocentric Life Assistantcited by 86
  2. 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
  3. 2023Temporal Action Localization for Inertial-based Human Activity Recognitioncited by 7
  4. 2025An Egocentric Vision-Language Model based Portable Real-time Smart Assistantcited by 7
  5. 2025Towards Generalizable Human Activity Recognition: A Surveycited by 6
  6. 2025EgoVITA: Learning to Plan and Verify for Egocentric Video Reasoningcited by 4
  7. 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
  8. 2024Weak-Annotation of HAR Datasets using Vision Foundation Modelscited by 2
  9. 2025γ-Quant: Towards Learnable Quantization for Low-bit Pattern Recognitioncited by 2
  10. 2025PIM: Physics-Informed Multi-task Pre-training for Improving Inertial Sensor-Based Human Activity Recognitioncited by 1
  11. 2025SlotFM: A Motion Foundation Model with Slot Attention for Diverse Downstream Taskscited by 1
  12. 2026HARMES: A Multi-Modal Dataset for Wearable Human Activity Recognition with Motion, Environmental Sensing and Soundcited by 1
18 more
  1. 2026Rethinking RAG in Long Videos: What to Retrieve and How to Use It?cited by 1
  2. 2024Left-Right Swapping and Upper-Lower Limb Pairing for Robust Multi-Wearable Workout Activity Detectioncited by 0
  3. 2024Enhancing Screen Time Identification in Children with a Multi-View Vision Language Model and Screen Time Trackercited by 0
  4. 2025Detecting Informative Channels: ActionFormercited by 0
  5. 2025DeepConvContext: A Multi-Scale Approach to Timeseries Classification in Human Activity Recognitioncited by 0
  6. 2025Label Leakage in Federated Inertial-based Human Activity Recognitioncited by 0
  7. 2025FedFitTech: A Baseline in Federated Learning for Fitness Trackingcited by 0
  8. 2026MobiDiary: Autoregressive Action Captioning with Wearable Devices and Wireless Signalscited by 0
  9. 2026WS-IMUBench: Can Weakly Supervised Methods from Audio, Image, and Video Be Adapted for IMU-based Temporal Action Localization?cited by 0
  10. 2026ActivityNarrated: An Open-Ended Narrative Paradigm for Wearable Human Activity Understandingcited by 0
  11. 2026BayaHAR: Lightweight Bayesian Few-Shot User Adaptation for On-Device Personalized Human Activity Recognitioncited by 0
  12. 2026WHAR Arena: Benchmarking the State of the Art in Efficient Wearable Human Activity Recognitioncited by 0
  13. 2026EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessmentcited by 0
  14. 2026ProcAgent: An Agentic Framework for Procedural Task Guidance on Edge with Human-in-the-Loopcited by 0
  15. 2026TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognitioncited by 0
  16. 2026Dynamic Influence-Weighted Distillation for Single-IMU Activity Recognitioncited by 0
  17. 2026RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohortscited by 0
  18. 2026PSEE: Progressive Sensor Event Expansion for Point-Supervised Temporal Action Localizationcited by 0