Continuous Meta-Learning without Tasks
Not on the map. Why?
Abstract (arXiv)
Meta-learning is a promising strategy for learning to efficiently learn within new tasks, using data gathered from a distribution of tasks. However, the meta-learning literature thus far has focused on the task segmented setting, where at train-time, offline data is assumed to be split according to the underlying task, and at test-time, the algorithms are optimized to learn in a single task. In this work, we enable the application of generic meta-learning algorithms to settings where this task segmentation is unavailable, such as continual online learning with a time-varying task. We present meta-learning via online changepoint analysis (MOCA), an approach which augments a meta-learning algorithm with a differentiable Bayesian changepoint detection scheme. The framework allows both training and testing directly on time series data without segmenting it into discrete tasks. We demonstrate the utility of this approach on a nonlinear meta-regression benchmark as well as two meta-image-classification benchmarks.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 14; 2023: 15; 2024: 7; 2025: 4; 2026: 2.
50 papers.
Sort:
By area:
- 2024Variational Bayesian Last Layerscited by 67
- 2021Continual Learning via Local Module Compositioncited by 61
- 2022On the Soft-Subnetwork for Few-shot Class Incremental Learningcited by 37
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 35
- 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluationcited by 34
- 2022A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biasescited by 30
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2022Learning Options via Compressioncited by 22
- 2021Sequoia: A Software Framework to Unify Continual Learning Researchcited by 19
- 2022Discrete Key-Value Bottleneckcited by 18
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2023Curious Replay for Model-based Adaptationcited by 16
38 more
- 2021CoMPS: Continual Meta Policy Searchcited by 15
- 2022Learning Mixtures of Linear Dynamical Systemscited by 15
- 2022Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?cited by 13
- 2022Self-Adaptive Driving in Nonstationary Environments through Conjectural Online Lookahead Adaptationcited by 12
- 2023When Meta-Learning Meets Online and Continual Learning: A Surveycited by 12
- 2023Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learningcited by 10
- 2021Bayesian Embeddings for Few-Shot Open World Recognitioncited by 8
- 2021Meta Learning on a Sequence of Imbalanced Domains with Difficulty Awarenesscited by 8
- 2023Clustering-based Domain-Incremental Learningcited by 8
- 2025On-device edge learning for IoT data streams: a surveycited by 8
- 2022Meta-Learning Parameterized Skillscited by 7
- 2023On Sequential Bayesian Inference for Continual Learningcited by 6
- 2022Time-Varying Propensity Score to Bridge the Gap between the Past and Presentcited by 5
- 2022Fully Online Meta-Learning Without Task Boundariescited by 4
- 2023Few-Shot Learning Patterns in Financial Time-Series for Trend-Following Strategiescited by 4
- 2023T-SaS: Toward Shift-aware Dynamic Adaptation for Streaming Datacited by 3
- 2025Task-Aware Virtual Training: Enhancing Generalization in Meta-Reinforcement Learning for Out-of-Distribution Taskscited by 3
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Drivingcited by 3
- 2023On the Generalization Error of Meta Learning for the Gibbs Algorithmcited by 2
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identificationcited by 2
- 2021Generalising via Meta-Examples for Continual Learning in the Wildcited by 1
- 2022Lifelong Wandering: A realistic few-shot online continual learning settingcited by 1
- 2023Algorithm Design for Online Meta-Learning with Task Boundary Detectioncited by 1
- 2023Neurosymbolic Meta-Reinforcement Lookahead Learning Achieves Safe Self-Driving in Non-Stationary Environmentscited by 1
- 2021Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognitioncited by 0
- 2022Reinforcement Learning with Brain-Inspired Modulation can Improve Adaptation to Environmental Changescited by 0
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instancescited by 0
- 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adaptercited by 0
- 2023GMTR: Graph Matching Transformerscited by 0
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Qualitycited by 0
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processingcited by 0
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networkscited by 0
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Imagecited by 0
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithmscited by 0
- 2024Towards General Deepfake Detection with Dynamic Curriculumcited by 0
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphscited by 0
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimationcited by 0
- 2026CoMetaPNS: Continually Meta-learning Personalized Neural Surrogates for Cardiac Electrophysiology Simulationscited by 0
- 2026CoMetaPNS: Continually Meta-learning Personalized Neural Surrogates for Cardiac Electrophysiology Simulations5 Jun 2026
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wild17 Mar 2026
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2025On-device edge learning for IoT data streams: a survey25 Feb 2025
- 2025Task-Aware Virtual Training: Enhancing Generalization in Meta-Reinforcement Learning for Out-of-Distribution Tasks5 Feb 2025
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024Variational Bayesian Last Layers17 Apr 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
38 more
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing6 Jan 2024
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Quality28 Dec 2023
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification12 Dec 2023
- 2023GMTR: Graph Matching Transformers14 Nov 2023
- 2023When Meta-Learning Meets Online and Continual Learning: A Survey9 Nov 2023
- 2023Few-Shot Learning Patterns in Financial Time-Series for Trend-Following Strategies16 Oct 2023
- 2023Clustering-based Domain-Incremental Learning21 Sep 2023
- 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adapter18 Sep 2023
- 2023T-SaS: Toward Shift-aware Dynamic Adaptation for Streaming Data5 Sep 2023
- 2023Neurosymbolic Meta-Reinforcement Lookahead Learning Achieves Safe Self-Driving in Non-Stationary Environments5 Sep 2023
- 2023Curious Replay for Model-based Adaptation28 Jun 2023
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learning28 May 2023
- 2023On the Generalization Error of Meta Learning for the Gibbs Algorithm27 Apr 2023
- 2023Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning20 Mar 2023
- 2023Algorithm Design for Online Meta-Learning with Task Boundary Detection2 Feb 2023
- 2023On Sequential Bayesian Inference for Continual Learning4 Jan 2023
- 2022Learning Options via Compression8 Dec 2022
- 2022Self-Adaptive Driving in Nonstationary Environments through Conjectural Online Lookahead Adaptation6 Oct 2022
- 2022Time-Varying Propensity Score to Bridge the Gap between the Past and Present4 Oct 2022
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning23 Sep 2022
- 2022A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases22 Sep 2022
- 2022On the Soft-Subnetwork for Few-shot Class Incremental Learning15 Sep 2022
- 2022Expanding continual few-shot learning benchmarks to include recognition of specific instances26 Aug 2022
- 2022Discrete Key-Value Bottleneck22 Jul 2022
- 2022Lifelong Wandering: A realistic few-shot online continual learning setting16 Jun 2022
- 2022Meta-Learning Parameterized Skills7 Jun 2022
- 2022Reinforcement Learning with Brain-Inspired Modulation can Improve Adaptation to Environmental Changes19 May 2022
- 2022Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?6 Mar 2022
- 2022Fully Online Meta-Learning Without Task Boundaries1 Feb 2022
- 2022Learning Mixtures of Linear Dynamical Systems26 Jan 2022
- 2021CoMPS: Continual Meta Policy Search8 Dec 2021
- 2021Continual Learning via Local Module Composition15 Nov 2021
- 2021Meta Learning on a Sequence of Imbalanced Domains with Difficulty Awareness29 Sep 2021
- 2021Sequoia: A Software Framework to Unify Continual Learning Research2 Aug 2021
- 2021Bayesian Embeddings for Few-Shot Open World Recognition29 Jul 2021
- 2021Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognition5 Jun 2021
- 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluation12 Mar 2021
- 2021Generalising via Meta-Examples for Continual Learning in the Wild28 Jan 2021
- 2024Variational Bayesian Last Layerscited by 67
- 2021Continual Learning via Local Module Compositioncited by 61
- 2022On the Soft-Subnetwork for Few-shot Class Incremental Learningcited by 37
- 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluationcited by 34
- 2022A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biasescited by 30
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2022Learning Options via Compressioncited by 22
- 2021Sequoia: A Software Framework to Unify Continual Learning Researchcited by 19
- 2022Discrete Key-Value Bottleneckcited by 18
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2023Curious Replay for Model-based Adaptationcited by 16
- 2021CoMPS: Continual Meta Policy Searchcited by 15
12 most cited of 47 All 47 (JSON)
- 2026CoMetaPNS: Continually Meta-learning Personalized Neural Surrogates for Cardiac Electrophysiology Simulations5 Jun 2026
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2025On-device edge learning for IoT data streams: a survey25 Feb 2025
- 2025Task-Aware Virtual Training: Enhancing Generalization in Meta-Reinforcement Learning for Out-of-Distribution Tasks5 Feb 2025
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024Variational Bayesian Last Layers17 Apr 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing6 Jan 2024
12 newest of 47 All 47 (JSON)