mlsanityData to 14 Oct 2026

MARAuder's Map: Motion-Aware Real-time Activity Recognition with Layout-Based Trajectories

arXiv 2511.05773 ↗First posted 8 Nov 2025cs.LG cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Ambient sensor-based human activity recognition (HAR) in smart homes remains challenging due to the need for real-time inference, spatially grounded reasoning, and context-aware temporal modeling. Existing approaches often rely on pre-segmented, within-activity data and overlook the physical layout of the environment, limiting their robustness in continuous, real-world deployments. In this paper, we propose MARAuder's Map, a novel framework for real-time activity recognition from raw, unsegmented sensor streams. Our method projects sensor activations onto the physical floorplan to generate trajectory-aware, image-like sequences that capture the spatial flow of human movement. These representations are processed by a hybrid deep learning model that jointly captures spatial structure and temporal dependencies. To enhance temporal awareness, we introduce a learnable time embedding module that encodes contextual cues such as hour-of-day and day-of-week. Additionally, an attention-based encoder selectively focuses on informative segments within each observation window, enabling accurate recognition even under cross-activity transitions and temporal ambiguity. Extensive experiments on multiple real-world smart home datasets demonstrate that our method outperforms strong baselines, offering a practical solution for real-time HAR in ambient sensor environments.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 74 references that are in the map. First posted on arXiv 8 Nov 2025.

Builds on

11 of 74 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  4. 20191D Convolutional Neural Networks and Applications: A Surveycited by 153
  5. 2019Relation-Aware Graph Attention Network for Visual Question Answeringcited by 119
  6. 2021Improving Deep Learning for HAR with shallow LSTMscited by 30
  7. 2021A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learningcited by 21
  8. 2021Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homescited by 12
  9. 2018Human Activity Recognition using Recurrent Neural Networkscited by 10
  10. 2019Activity2Vec: Learning ADL Embeddings from Sensor Data with a Sequence-to-Sequence Modelcited by 8
  11. 2019Online Human Activity Recognition Employing Hierarchical Hidden Markov Modelscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.