mlsanityData to 7 Oct 2026

LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models

arXiv 2606.09430 ↗First posted 8 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Online task-free continual learning (TFCL) requires intelligent agents to sequentially accumulate knowledge from an unbounded, non-stationary data stream under strict single-pass constraints and without any explicit task identifiers. Existing online TFCL paradigms primarily rely on parameter-efficient prompt tuning or dynamic structure expansion driven by training-coupled optimization dynamics, such as empirical loss fluctuations or evolving latent distances. As a result, these training-coupled solvers remain agnostic to the structural origins of distribution drift, mechanically enforcing a fixed strategy across fundamentally distinct streaming variations. To address this gap, we propose LargeMonitor, a framework that leverages large pretrained foundation models to autonomously orchestrate task-free continuous adaptation. Specifically, LargeMonitor introduces a decoupled detection module utilizing the frozen, stable representation space of large vision models (LVMs) to achieve robust, zero-shot drift detection without training-dependent interference or brittle threshold tuning. Upon a confirmed drift, the framework activates a context-aware diagnostic module driven by large multimodal models (LMMs) to interpret the precise semantic etiologies of the stream variation (e.g., novel class emergence vs. environmental domain shift). This dual-stage capability empowers the continuous learner to dynamically deploy adaptive and shift-specific optimization strategies. Extensive experiments across multiple TFCL settings and benchmarks demonstrate that LargeMonitor achieves precise, robust detection and diagnosis of complex data streams while consistently improving the performance of existing online TFCL algorithms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

29 of 38 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2016Learning without Forgettingcited by 2,465
  8. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  9. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  10. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  11. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  12. 2025DINOv3cited by 1,297
17 more
  1. 2018Experience Replay for Continual Learningcited by 1,074
  2. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  3. 2021Learning to Prompt for Continual Learningcited by 938
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  5. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  6. 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
  7. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  8. 2018Task-Free Continual Learningcited by 219
  9. 2019REMIND Your Neural Network to Prevent Catastrophic Forgettingcited by 197
  10. 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
  11. 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 143
  12. 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 133
  13. 2021Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inferencecited by 66
  14. 2023Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuningcited by 35
  15. 2024Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptationcited by 26
  16. 2024Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robotscited by 6
  17. 2026Can Vision-Language-Action Models Learn from Real-World Data Continually without Forgetting?cited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026On Token's Dilemma: Dynamic MoE with Drift-Aware Token Assignment for Continual Learning of Large Vision Language Models
  2. 2025LLaVA-CMoE: Towards Continual Mixture of Experts for Large Vision-Language Models
  3. 2024Enhancing Online Continual Learning with Plug-and-Play State Space Model and Class-Conditional Mixture of Discretization
  4. 2026Generalizable and Adaptive Continual Learning Framework for AI-generated Image Detection
  5. 2024Continual LLaVA: Continual Instruction Tuning in Large Vision-Language Models
  6. 2026Decomposing and Composing: Towards Efficient Vision-Language Continual Learning via Rank-1 Expert Pool in a Single LoRA
  7. 2026Black-Box Continual Learning for Vision-Language Models
  8. 2026DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models