Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference
Not on the map. Why?
Abstract (arXiv)
Despite rapid advances in continual learning, a large body of research is devoted to improving performance in the existing setups. While a handful of work do propose new continual learning setups, they still lack practicality in certain aspects. For better practicality, we first propose a novel continual learning setup that is online, task-free, class-incremental, of blurry task boundaries and subject to inference queries at any moment. We additionally propose a new metric to better measure the performance of the continual learning methods subject to inference queries at any moment. To address the challenging setup and evaluation protocol, we propose an effective method that employs a new memory management scheme and novel learning techniques. Our empirical validation demonstrates that the proposed method outperforms prior arts by large margins. Code and data splits are available at https://github.com/naver-ai/i-Blurry.
Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
39 of 49 references.
References · 39
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2016Progressive Neural Networkscited by 1,361
- 2017Continual Learning with Deep Generative Replaycited by 1,158
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2018Experience Replay for Continual Learningcited by 1,095
- 2018Efficient Lifelong Learning with A-GEMcited by 1,058
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 742
- 2019Large Scale Incremental Learningcited by 732
27 more
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
- 2018End-to-End Incremental Learningcited by 597
- 2019Gradient based sample selection for online continual learningcited by 571
- 2019Online Continual Learning with Maximally Interfered Retrievalcited by 379
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
- 2021Gradient Projection Memory for Continual Learningcited by 348
- 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 328
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
- 2017Overcoming Catastrophic Forgetting by Incremental Moment Matchingcited by 243
- 2018Task-Free Continual Learningcited by 221
- 2020Mnemonics Training: Multi-Class Incremental Learning without Forgettingcited by 221
- 2020Understanding the Role of Training Regimes in Continual Learningcited by 180
- 2017Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samplescited by 147
- 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 134
- 2019Scalable and Order-robust Continual Learning with Additive Parameter Decompositioncited by 125
- 2019Uncertainty-guided Continual Learning with Bayesian Neural Networkscited by 102
- 2020GAN Memory with No Forgettingcited by 84
- 2018Memory Replay GANs: learning to generate images from new categories without forgettingcited by 77
- 2020Imbalanced Continual Learning with Partitioning Reservoir Samplingcited by 72
- 2020Incremental Learning In Online Scenariocited by 71
- 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70
- 2019Superposition of many models into onecited by 64
- 2021Class-Incremental Learning with Generative Classifierscited by 39
- 2016Importance Sampling for Minibatchescited by 36
- 2017NSML: A Machine Learning Platform That Enables You to Focus on Your Modelscited by 34
- 2019Incremental Learning with Maximum Entropy Regularization: Rethinking Forgetting and Intransigencecited by 12
Built on by
Citing papers per year: 2022: 2; 2023: 23; 2024: 20; 2025: 10; 2026: 12.
67 papers.
Sort:
By area:
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2023Computationally Budgeted Continual Learning: What Does Matter?cited by 61
- 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
- 2024SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detectioncited by 44
- 2023Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuningcited by 35
- 2023Online Continual Learning Without the Storage Constraintcited by 29
- 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptationcited by 27
- 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
- 2023A Comprehensive Empirical Evaluation on Online Continual Learningcited by 24
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
- 2024Online Continual Learning For Interactive Instruction Following Agentscited by 22
- 2024GACL: Exemplar-Free Generalized Analytic Continual Learningcited by 22
38 more
- 2023CBA: Improving Online Continual Learning via Continual Bias Adaptorcited by 16
- 2023Improving Online Continual Learning Performance and Stability with Temporal Ensemblescited by 14
- 2023GRASP: A Rehearsal Policy for Efficient Online Continual Learningcited by 14
- 2023Overcoming the Stability Gap in Continual Learningcited by 13
- 2024Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental Learningcited by 13
- 2024Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learningcited by 12
- 2023Online Continual Learning on Hierarchical Label Expansioncited by 11
- 2023Continual Learning for Predictive Maintenance: Overview and Challengescited by 10
- 2023Rapid Adaptation in Online Continual Learning: Are We Evaluating It Right?cited by 10
- 2024Continual Learning in the Presence of Repetitioncited by 10
- 2023Class-Incremental Learning with Repetitioncited by 9
- 2025Advancing Prompt-Based Methods for Replay-Independent General Continual Learningcited by 9
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuningcited by 9
- 2023Clustering-based Domain-Incremental Learningcited by 8
- 2023One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learningcited by 8
- 2024AIR: Analytic Imbalance Rectifier for Continual Learningcited by 8
- 2024Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Samplingcited by 7
- 2022Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Modelscited by 5
- 2023Online Continual Learning via Logit Adjusted Softmaxcited by 5
- 2023Modyn: Data-Centric Machine Learning Pipeline Orchestrationcited by 5
- 2023Class-Wise Buffer Management for Incremental Object Detection: An Effective Buffer Training Strategycited by 5
- 2023Doubly Perturbed Task Free Continual Learningcited by 5
- 2024Coherent Temporal Synthesis for Incremental Action Segmentationcited by 5
- 2024Online Continuous Generalized Category Discoverycited by 5
- 2024Continual Learning Using Only Large Language Model Promptingcited by 5
- 2023VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inferencecited by 4
- 2024Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computationcited by 4
- 2025Online Continual Graph Learningcited by 3
- 2023HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learningcited by 2
- 2023Adaptive Shortcut Debiasing for Online Continual Learningcited by 2
- 2024Semantic Prompting with Image-Token for Continual Learningcited by 2
- 2024CLIP model is an Efficient Online Lifelong Learnercited by 2
- 2024Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspectivecited by 2
- 2024Not Just Object, But State: Compositional Incremental Learning without Forgettingcited by 2
- 2025Continual Multiple Instance Learning with Enhanced Localization for Histopathological Whole Slide Image Analysiscited by 2
- 2026FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learningcited by 2
- 2022Lifelong Wandering: A realistic few-shot online continual learning settingcited by 1
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1
50 most cited of 67 All 67 (JSON)
- 2026Online Versatile Incremental Learning: Towards Class and Domain-Agnostic Adaptation at Any Time29 Sep 2026
- 2026Brain-Inspired Hierarchical Modularity for General Continual Learning21 Sep 2026
- 2026MePo++: Unifying Representation Refinement and Reconciliation for General Continual Learning4 Sep 2026
- 2026LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models8 Jun 2026
- 2026DRIFT: A Benchmark for Task-Free Continual Graph Learning with Continuous Distribution Shifts13 May 2026
- 2026Online Continual Learning with Dynamic Label Hierarchies12 May 2026
- 2026Is Prompt Selection Necessary for Task-Free Online Continual Learning?6 Apr 2026
- 2026Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation9 Mar 2026
- 2026Online Continual Learning for Anomaly Detection in IoT under Data Distribution Shifts8 Mar 2026
- 2026MePo: Meta Post-Refinement for Rehearsal-Free General Continual Learning8 Feb 2026
- 2026FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning2 Feb 2026
- 2026RoAD Benchmark: How LiDAR Models Fail under Coupled Domain Shifts and Label Evolution9 Jan 2026
38 more
- 2025Learning After Model Deployment20 Oct 2025
- 2025The Unreasonable Effectiveness of Randomized Representations in Online Continual Graph Learning8 Oct 2025
- 2025Online Continual Graph Learning5 Aug 2025
- 2025Continual Learning with Support Boundary Experience Blending31 Jul 2025
- 2025Toward Long-Tailed Online Anomaly Detection through Class-Agnostic Concepts22 Jul 2025
- 2025PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online Learning16 Jul 2025
- 2025Continual Multiple Instance Learning with Enhanced Localization for Histopathological Whole Slide Image Analysis3 Jul 2025
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuning27 May 2025
- 2025A Good Start Matters: Enhancing Continual Learning with Data-Driven Weight Initialization9 Mar 2025
- 2025Advancing Prompt-Based Methods for Replay-Independent General Continual Learning2 Mar 2025
- 2024Continual Learning Using Only Large Language Model Prompting20 Dec 2024
- 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation8 Nov 2024
- 2024Not Just Object, But State: Compositional Incremental Learning without Forgetting4 Nov 2024
- 2024Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling19 Oct 2024
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation3 Oct 2024
- 2024Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning28 Sep 2024
- 2024Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective26 Aug 2024
- 2024Online Continuous Generalized Category Discovery24 Aug 2024
- 2024AIR: Analytic Imbalance Rectifier for Continual Learning19 Aug 2024
- 2024CLIP model is an Efficient Online Lifelong Learner24 May 2024
- 2024Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental Learning17 May 2024
- 2024Continual Learning in the Presence of Repetition7 May 2024
- 2024Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation19 Apr 2024
- 2024GACL: Exemplar-Free Generalized Analytic Continual Learning23 Mar 2024
- 2024Semantic Prompting with Image-Token for Continual Learning18 Mar 2024
- 2024Online Continual Learning For Interactive Instruction Following Agents12 Mar 2024
- 2024Coherent Temporal Synthesis for Incremental Action Segmentation10 Mar 2024
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model8 Mar 2024
- 2024SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection27 Feb 2024
- 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptation13 Feb 2024
- 2023Doubly Perturbed Task Free Continual Learning20 Dec 2023
- 2023Class-Wise Buffer Management for Incremental Object Detection: An Effective Buffer Training Strategy14 Dec 2023
- 2023Adaptive Shortcut Debiasing for Online Continual Learning14 Dec 2023
- 2023Modyn: Data-Centric Machine Learning Pipeline Orchestration11 Dec 2023
- 2023One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learning18 Nov 2023
- 2023Online Continual Learning via Logit Adjusted Softmax11 Nov 2023
- 2023HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning26 Sep 2023
- 2023Clustering-based Domain-Incremental Learning21 Sep 2023
50 newest of 67 All 67 (JSON)
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2023Computationally Budgeted Continual Learning: What Does Matter?cited by 61
- 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
- 2023Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuningcited by 35
- 2023Online Continual Learning Without the Storage Constraintcited by 29
- 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptationcited by 27
- 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
- 2023A Comprehensive Empirical Evaluation on Online Continual Learningcited by 24
- 2024Online Continual Learning For Interactive Instruction Following Agentscited by 22
- 2024GACL: Exemplar-Free Generalized Analytic Continual Learningcited by 22
- 2023CBA: Improving Online Continual Learning via Continual Bias Adaptorcited by 16
- 2023Improving Online Continual Learning Performance and Stability with Temporal Ensemblescited by 14
12 most cited of 64 All 64 (JSON)
- 2026Brain-Inspired Hierarchical Modularity for General Continual Learning21 Sep 2026
- 2026MePo++: Unifying Representation Refinement and Reconciliation for General Continual Learning4 Sep 2026
- 2026LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models8 Jun 2026
- 2026DRIFT: A Benchmark for Task-Free Continual Graph Learning with Continuous Distribution Shifts13 May 2026
- 2026Online Continual Learning with Dynamic Label Hierarchies12 May 2026
- 2026Is Prompt Selection Necessary for Task-Free Online Continual Learning?6 Apr 2026
- 2026Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation9 Mar 2026
- 2026Online Continual Learning for Anomaly Detection in IoT under Data Distribution Shifts8 Mar 2026
- 2026MePo: Meta Post-Refinement for Rehearsal-Free General Continual Learning8 Feb 2026
- 2026FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning2 Feb 2026
- 2026RoAD Benchmark: How LiDAR Models Fail under Coupled Domain Shifts and Label Evolution9 Jan 2026
- 2025Learning After Model Deployment20 Oct 2025
12 newest of 64 All 64 (JSON)