mlsanityData to 14 Oct 2026

MePo++: Unifying Representation Refinement and Reconciliation for General Continual Learning

arXiv 2609.05075 ↗First posted 4 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

General continual learning (GCL) aims to learn from evolving data streams without task identities, explicit boundaries, or repeated access to previous data, making it a realistic yet challenging setting for continual intelligence. Although pretrained models (PTMs) provide rich prior knowledge for addressing the limited supervision and non-stationary nature of GCL, existing PTM-based methods often directly adapt pretrained representations and overlook two critical gaps: the misalignment between upstream pretraining and downstream continual adaptation, and the unreliability of conventional output alignment under blurry streams. Here we propose MePo++, a unified post-training framework that bridges pretrained knowledge and downstream GCL through representation refinement and reconciliation. MePo++ introduces two complementary components: MetaPrep, which improves representation plasticity for continual adaptation through unsupervised meta-refinement over pseudo continual sequences; and StreamAlign, which reinforces representation stability by reconciling evolving online features with a stable pretrained geometry. By improving representation learnability before adaptation and preserving alignment during continual learning, MePo++ enables PTMs to remain both plastic for new concepts and stable over evolving streams. Experiments across diverse PTMs, datasets, and continual learning baselines demonstrate the consistent effectiveness and generality of MePo++ for PTM-based GCL. Our code is available at https://github.com/SunGL001/MePo_Plus.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 53 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

3 of 53 references.

References · 3

  1. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  2. 2019Three scenarios for continual learningcited by 614
  3. 2021Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inferencecited by 67

Built on by

Not cited yet.