mlsanityData to 14 Oct 2026

Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference

arXiv 2110.10031 ↗First posted 19 Oct 2021cs.LG cs.CVcited by 67

Not on the map. Why?

Abstract (arXiv)

Despite rapid advances in continual learning, a large body of research is devoted to improving performance in the existing setups. While a handful of work do propose new continual learning setups, they still lack practicality in certain aspects. For better practicality, we first propose a novel continual learning setup that is online, task-free, class-incremental, of blurry task boundaries and subject to inference queries at any moment. We additionally propose a new metric to better measure the performance of the continual learning methods subject to inference queries at any moment. To address the challenging setup and evaluation protocol, we propose an effective method that employs a new memory management scheme and novel learning techniques. Our empirical validation demonstrates that the proposed method outperforms prior arts by large margins. Code and data splits are available at https://github.com/naver-ai/i-Blurry.

Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 19 Oct 2021.

Builds on

39 of 49 references.

References · 39

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  3. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  5. 2016Progressive Neural Networkscited by 1,361
  6. 2017Continual Learning with Deep Generative Replaycited by 1,158
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  8. 2018Experience Replay for Continual Learningcited by 1,095
  9. 2018Efficient Lifelong Learning with A-GEMcited by 1,058
  10. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
  11. 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 742
  12. 2019Large Scale Incremental Learningcited by 732
27 more
  1. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  2. 2018End-to-End Incremental Learningcited by 597
  3. 2019Gradient based sample selection for online continual learningcited by 571
  4. 2019Online Continual Learning with Maximally Interfered Retrievalcited by 379
  5. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
  6. 2021Gradient Projection Memory for Continual Learningcited by 348
  7. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 328
  8. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  9. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
  10. 2017Overcoming Catastrophic Forgetting by Incremental Moment Matchingcited by 243
  11. 2018Task-Free Continual Learningcited by 221
  12. 2020Mnemonics Training: Multi-Class Incremental Learning without Forgettingcited by 221
  13. 2020Understanding the Role of Training Regimes in Continual Learningcited by 180
  14. 2017Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samplescited by 147
  15. 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 134
  16. 2019Scalable and Order-robust Continual Learning with Additive Parameter Decompositioncited by 125
  17. 2019Uncertainty-guided Continual Learning with Bayesian Neural Networkscited by 102
  18. 2020GAN Memory with No Forgettingcited by 84
  19. 2018Memory Replay GANs: learning to generate images from new categories without forgettingcited by 77
  20. 2020Imbalanced Continual Learning with Partitioning Reservoir Samplingcited by 72
  21. 2020Incremental Learning In Online Scenariocited by 71
  22. 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70
  23. 2019Superposition of many models into onecited by 64
  24. 2021Class-Incremental Learning with Generative Classifierscited by 39
  25. 2016Importance Sampling for Minibatchescited by 36
  26. 2017NSML: A Machine Learning Platform That Enables You to Focus on Your Modelscited by 34
  27. 2019Incremental Learning with Maximum Entropy Regularization: Rethinking Forgetting and Intransigencecited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 23; 2024: 20; 2025: 10; 2026: 12.

67 papers.

Sort:

By area:

  1. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  2. 2023Computationally Budgeted Continual Learning: What Does Matter?cited by 61
  3. 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
  4. 2024SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detectioncited by 44
  5. 2023Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuningcited by 35
  6. 2023Online Continual Learning Without the Storage Constraintcited by 29
  7. 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptationcited by 27
  8. 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
  9. 2023A Comprehensive Empirical Evaluation on Online Continual Learningcited by 24
  10. 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
  11. 2024Online Continual Learning For Interactive Instruction Following Agentscited by 22
  12. 2024GACL: Exemplar-Free Generalized Analytic Continual Learningcited by 22
38 more
  1. 2023CBA: Improving Online Continual Learning via Continual Bias Adaptorcited by 16
  2. 2023Improving Online Continual Learning Performance and Stability with Temporal Ensemblescited by 14
  3. 2023GRASP: A Rehearsal Policy for Efficient Online Continual Learningcited by 14
  4. 2023Overcoming the Stability Gap in Continual Learningcited by 13
  5. 2024Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental Learningcited by 13
  6. 2024Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learningcited by 12
  7. 2023Online Continual Learning on Hierarchical Label Expansioncited by 11
  8. 2023Continual Learning for Predictive Maintenance: Overview and Challengescited by 10
  9. 2023Rapid Adaptation in Online Continual Learning: Are We Evaluating It Right?cited by 10
  10. 2024Continual Learning in the Presence of Repetitioncited by 10
  11. 2023Class-Incremental Learning with Repetitioncited by 9
  12. 2025Advancing Prompt-Based Methods for Replay-Independent General Continual Learningcited by 9
  13. 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuningcited by 9
  14. 2023Clustering-based Domain-Incremental Learningcited by 8
  15. 2023One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learningcited by 8
  16. 2024AIR: Analytic Imbalance Rectifier for Continual Learningcited by 8
  17. 2024Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Samplingcited by 7
  18. 2022Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Modelscited by 5
  19. 2023Online Continual Learning via Logit Adjusted Softmaxcited by 5
  20. 2023Modyn: Data-Centric Machine Learning Pipeline Orchestrationcited by 5
  21. 2023Class-Wise Buffer Management for Incremental Object Detection: An Effective Buffer Training Strategycited by 5
  22. 2023Doubly Perturbed Task Free Continual Learningcited by 5
  23. 2024Coherent Temporal Synthesis for Incremental Action Segmentationcited by 5
  24. 2024Online Continuous Generalized Category Discoverycited by 5
  25. 2024Continual Learning Using Only Large Language Model Promptingcited by 5
  26. 2023VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inferencecited by 4
  27. 2024Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computationcited by 4
  28. 2025Online Continual Graph Learningcited by 3
  29. 2023HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learningcited by 2
  30. 2023Adaptive Shortcut Debiasing for Online Continual Learningcited by 2
  31. 2024Semantic Prompting with Image-Token for Continual Learningcited by 2
  32. 2024CLIP model is an Efficient Online Lifelong Learnercited by 2
  33. 2024Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspectivecited by 2
  34. 2024Not Just Object, But State: Compositional Incremental Learning without Forgettingcited by 2
  35. 2025Continual Multiple Instance Learning with Enhanced Localization for Histopathological Whole Slide Image Analysiscited by 2
  36. 2026FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learningcited by 2
  37. 2022Lifelong Wandering: A realistic few-shot online continual learning settingcited by 1
  38. 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1

50 most cited of 67 All 67 (JSON)