WS-IMUBench: Can Weakly Supervised Methods from Audio, Image, and Video Be Adapted for IMU-based Temporal Action Localization?
Not on the map. Why?
Abstract (arXiv)
IMU-based Human Activity Recognition (HAR) has enabled a wide range of ubiquitous computing applications, yet its dominant clip classification paradigm cannot capture the rich temporal structure of real-world behaviors. This motivates a shift toward IMU Temporal Action Localization (IMU-TAL), which predicts both action categories and their start/end times in continuous streams. However, current progress is strongly bottlenecked by the need for dense, frame-level boundary annotations, which are costly and difficult to scale. To address this bottleneck, we introduce WS-IMUBench, a systematic benchmark study of weakly supervised IMU-TAL (WS-IMU-TAL) under only sequence-level labels. Rather than proposing a new localization algorithm, we evaluate how well established weakly supervised localization paradigms from audio, image, and video transfer to IMU-TAL under only sequence-level labels. We benchmark seven representative weakly supervised methods on seven public IMU datasets, resulting in over 3,540 model training runs and 7,080 inference evaluations. Guided by three research questions on transferability, effectiveness, and insights, our findings show that (i) transfer is modality-dependent, with temporal-domain methods generally more stable than image-derived proposal-based approaches; (ii) weak supervision can be competitive on favorable datasets (e.g., with longer actions and higher-dimensional sensing); and (iii) dominant failure modes arise from short actions, temporal ambiguity, and proposal quality. Finally, we outline concrete directions for advancing WS-IMU-TAL (e.g., IMU-specific proposal generation, boundary-aware objectives, and stronger temporal reasoning). Beyond individual results, WS-IMUBench establishes a reproducible benchmarking template, datasets, protocols, and analyses, to accelerate community-wide progress toward scalable WS-IMU-TAL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 57 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
28 of 57 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
- 2015Weakly Supervised Deep Detection Networkscited by 183
- 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 141
- 2017Multiple Instance Detection Network with Online Instance Classifier Refinementcited by 117
- 2017Weakly Supervised Action Localization by Sparse Temporal Pooling Networkcited by 100
- 2018PCL: Proposal Cluster Learning for Weakly Supervised Object Detectioncited by 97
- 2020Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detectioncited by 80
- 2018AutoLoc: Weakly-supervised Temporal Action Localizationcited by 75
16 more
- 2019Background Suppression Network for Weakly-supervised Temporal Action Localizationcited by 73
- 2021CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learningcited by 69
- 2020Weakly-Supervised Action Localization by Generative Attention Modelingcited by 58
- 2019Weakly-supervised Action Localization with Background Modelingcited by 53
- 2017Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detectioncited by 46
- 2021Learning Action Completeness from Points for Weakly-supervised Temporal Action Localizationcited by 42
- 2018A Comparison of Five Multiple Instance Learning Pooling Functions for Sound Event Detection with Weak Labelingcited by 37
- 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 35
- 2022Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagationcited by 32
- 2023WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognitioncited by 30
- 2018Adaptive pooling operators for weakly labeled sound event detectioncited by 21
- 2021Weakly Supervised Action Selection Learning in Videocited by 21
- 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
- 2023Hang-Time HAR: A Benchmark Dataset for Basketball Activity Recognition using Wrist-Worn Inertial Sensorscited by 11
- 2021Towards duration robust weakly supervised sound event detectioncited by 10
- 2025XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and Glassescited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Exploring Scalability of Self-Training for Open-Vocabulary Temporal Action Localization
- 2026OZ-TAL: Online Zero-Shot Temporal Action Localization
- 2024Probabilistic Vision-Language Representation for Weakly Supervised Temporal Action Localization
- 2025Towards Generalizable Human Activity Recognition: A Survey
- 2022Distilling Vision-Language Pre-training to Collaborate with Weakly-Supervised Temporal Action Localization
- 2026Skeleton-based Zero-Shot Spatio-Temporal Action Localization via Weakly-Supervised Pretraining
- 2026OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization
- 2024UAL-Bench: The First Comprehensive Unusual Activity Localization Benchmark