mlsanityData to 7 Oct 2026

Gated Adaptation for Continual Learning in Human Activity Recognition

arXiv 2603.10046 ↗First posted 8 Mar 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Wearable sensors in Internet of Things (IoT) ecosystems increasingly support applications such as remote health monitoring, elderly care, and smart home automation, all of which rely on robust human activity recognition (HAR). Continual learning systems must balance plasticity (learning new tasks) with stability (retaining prior knowledge), yet AI models often exhibit catastrophic forgetting, where learning new tasks degrades performance on earlier ones. This challenge is especially acute in domain-incremental HAR, where on-device models must adapt to new subjects with distinct movement patterns while maintaining accuracy on prior subjects without transmitting sensitive data to the cloud. We propose a parameter-efficient continual learning framework based on channel-wise gated modulation of frozen pretrained representations. Our key insight is that adaptation should operate through feature selection rather than feature generation: by restricting learned transformations to diagonal scaling of existing features, we preserve the geometry of pretrained representations while enabling subject-specific modulation. We provide a theoretical analysis showing that gating implements a bounded diagonal operator that limits representational drift compared to unconstrained linear transformations. Empirically, freezing the backbone substantially reduces forgetting, and lightweight gates restore lost adaptation capacity, achieving stability and plasticity simultaneously. On PAMAP2 with 8 sequential subjects, our approach reduces forgetting from 39.7% to 16.2% and improves final accuracy from 56.7% to 77.7%, while training less than 2% of parameters. Our method matches or exceeds standard continual learning baselines without replay buffers or task-specific regularization, confirming that structured diagonal operators are effective and efficient under distribution shift.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 52 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

31 of 52 references.

References · 31

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2017Squeeze-and-Excitation Networkscited by 4,763
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  6. 2016Learning without Forgettingcited by 2,465
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  8. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  10. 2016Progressive Neural Networkscited by 1,332
  11. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  12. 2017Continual Learning with Deep Generative Replaycited by 1,152
19 more
  1. 2021Learning to Prompt for Continual Learningcited by 938
  2. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  3. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  5. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
  6. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  7. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  8. 2023Class-Incremental Learning: A Surveycited by 209
  9. 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
  10. 2020Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunitiescited by 125
  11. 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
  12. 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
  13. 2024Continual Learning and Catastrophic Forgettingcited by 73
  14. 2021Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysiscited by 21
  15. 2025AttenGluco: Multimodal Transformer-Based Blood Glucose Forecasting on AI-READI Datasetcited by 9
  16. 2024Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Modelscited by 8
  17. 2022Lifelong Adaptive Machine Learning for Sensor-based Human Activity Recognition Using Prototypical Networkscited by 7
  18. 2024Balancing Continual Learning and Fine-tuning for Human Activity Recognitioncited by 3
  19. 2025CLAD-Net: Continual Activity Recognition in Multi-Sensor Wearable Systemscited by 1

Built on by

Not cited yet.