mlsanityData to 14 Oct 2026

You Don't Need Attention: Gated Convolutional Modeling for Watch-Based Fall Detection

arXiv 2605.20275 ↗First posted 19 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing deep learning approaches for wearable fall detection systems rely on self-attention mechanisms that impose quadratic computational overhead, distributing weights across all time steps. This global weight distribution impairs the precise localization of the brief impact signatures that characterize falls within short, fixed-length windows. To overcome this challenge, we propose Gated-CNN, a lightweight dual-stream architecture that processes accelerometer and gyroscope streams through independent one-dimensional convolutional feature extractors, followed by (i) a sigmoid gating module that selectively suppresses uninformative background activations while amplifying fall-discriminative features, (ii) a global average pooling layer that compresses each stream into a compact fixed-length descriptor, and (iii) a shared classification head that fuses both descriptors for binary fall prediction. For offline evaluation, we evaluate the model across five wrist-mounted inertial measurement unit (IMU) datasets, achieving average F1-scores of 93%, 93%, 90%, 91%, and 90% on SmartFallMM, WEDA-Fall, FallAllD, UMAFall, and UP-Fall, outperforming Transformer baselines. For real-time evaluation, we deployed the model on a Google Pixel Watch 3 and tested across 12 participants. The model achieves an average F1-score of 97% and an accuracy of 98% with zero missed falls, showing that sigmoid gating offers a more structurally aligned and computationally efficient alternative to attention for commodity smartwatch-based fall detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 29 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

5 of 29 references.

References · 5

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016Language Modeling with Gated Convolutional Networkscited by 702
  4. 2021Gated Transformer Networks for Multivariate Time Series Classificationcited by 58
  5. 2025Limitations of Normalization in Attention Mechanismcited by 7

Built on by

Not cited yet.