MARAuder's Map: Motion-Aware Real-time Activity Recognition with Layout-Based Trajectories
Not on the map. Why?
Abstract (arXiv)
Ambient sensor-based human activity recognition (HAR) in smart homes remains challenging due to the need for real-time inference, spatially grounded reasoning, and context-aware temporal modeling. Existing approaches often rely on pre-segmented, within-activity data and overlook the physical layout of the environment, limiting their robustness in continuous, real-world deployments. In this paper, we propose MARAuder's Map, a novel framework for real-time activity recognition from raw, unsegmented sensor streams. Our method projects sensor activations onto the physical floorplan to generate trajectory-aware, image-like sequences that capture the spatial flow of human movement. These representations are processed by a hybrid deep learning model that jointly captures spatial structure and temporal dependencies. To enhance temporal awareness, we introduce a learnable time embedding module that encodes contextual cues such as hour-of-day and day-of-week. Additionally, an attention-based encoder selectively focuses on informative segments within each observation window, enabling accurate recognition even under cross-activity transitions and temporal ambiguity. Extensive experiments on multiple real-world smart home datasets demonstrate that our method outperforms strong baselines, offering a practical solution for real-time HAR in ambient sensor environments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 74 references that are in the map. First posted on arXiv 8 Nov 2025.
Builds on
11 of 74 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 20191D Convolutional Neural Networks and Applications: A Surveycited by 153
- 2019Relation-Aware Graph Attention Network for Visual Question Answeringcited by 119
- 2021Improving Deep Learning for HAR with shallow LSTMscited by 30
- 2021A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learningcited by 21
- 2021Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homescited by 12
- 2018Human Activity Recognition using Recurrent Neural Networkscited by 10
- 2019Activity2Vec: Learning ADL Embeddings from Sensor Data with a Sequence-to-Sequence Modelcited by 8
- 2019Online Human Activity Recognition Employing Hierarchical Hidden Markov Modelscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.