Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasks
Not on the map. Why?
Abstract (arXiv)
Despite much research targeted at enabling conventional machine learning models to continually learn tasks and data distributions sequentially without forgetting the knowledge acquired, little effort has been devoted to account for more realistic situations where learning some tasks accurately might be more critical than forgetting previous ones. In this paper we propose a Bayesian inference based framework to continually learn a set of real-world, sensing-based analysis tasks that can be tuned to prioritize the remembering of previously learned tasks or the learning of new ones. Our experiments prove the robustness and reliability of the learned models to adapt to the changing sensing environment, and show the suitability of using uncertainty of the predictions to assess their reliability.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 6 Jun 2021.
Builds on
13 of 30 references.
References · 13
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2017Continual Learning with Deep Generative Replaycited by 1,158
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 742
- 2015Variational Dropout and the Local Reparameterization Trickcited by 490
- 2017Variational Continual Learningcited by 339
- 2017Deep Learning for Sensor-based Activity Recognition: A Surveycited by 133
- 2013Streaming Variational Bayescited by 48
- 2018FastDeepIoT: Towards Understanding and Optimizing Neural Network Execution Time on Mobile and Embedded Devicescited by 14
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 2; 2024: 0; 2025: 1.
7 papers.
- 2021Exploring System Performance of Continual Learning for Mobile and Embedded Sensing Applicationscited by 17
- 2023LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing Platformscited by 11
- 2021FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applicationscited by 9
- 2023IBCL: Zero-shot Model Generation under Stability-Plasticity Trade-offscited by 5
- 2022Enabling On-Device Smartphone GPU based Training: Lessons Learnedcited by 4
- 2022YONO: Modeling Multiple Heterogeneous Neural Networks on Microcontrollerscited by 4
- 2025MetaCLBench: Meta Continual Learning Benchmark on Resource-Constrained Edge Devicescited by 0
- 2025MetaCLBench: Meta Continual Learning Benchmark on Resource-Constrained Edge Devices31 Mar 2025
- 2023LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing Platforms19 Nov 2023
- 2023IBCL: Zero-shot Model Generation under Stability-Plasticity Trade-offs24 May 2023
- 2022YONO: Modeling Multiple Heterogeneous Neural Networks on Microcontrollers8 Mar 2022
- 2022Enabling On-Device Smartphone GPU based Training: Lessons Learned21 Feb 2022
- 2021Exploring System Performance of Continual Learning for Mobile and Embedded Sensing Applications25 Oct 2021
- 2021FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applications14 Jun 2021