Distribution-Conditioned Task Routing for Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Parameter-efficient adaptation enables continual learners to acquire task-specific knowledge through compact model updates while maintaining strong within-task performance. However, class-incremental inference requires each input to be classified among all classes seen so far without access to its task identity. For learners equipped with task-specific parameter-efficient modules, this introduces a critical task-routing challenge beyond catastrophic forgetting. We study post-hoc task routing without retraining the learner or introducing a separately trained router. Such training-free inference-time calibration remains comparatively underexplored in parameter-efficient class-incremental learning. We identify three sources of routing error (feature-level, task-level, and class-level misalignment) and propose Feature Distribution Calibration (FDC). Its three components address these misalignments: Task Subspace Filtering (TSF) suppresses feature components outside each task's principal subspace, Residual Likelihood Calibration (RLC) evaluates the typicality of its subspace residual, and Prototype Affinity Calibration (PAC) measures compatibility with the task's class prototypes. Experiments demonstrate plug-and-play applicability to eight parameter-efficient class-incremental methods using a shared encoder. With one component configuration selected per method across all five benchmarks, FDC improves final accuracy in all 40 method-dataset pairs by 4.39 percentage points on average. Enabling all components improves 35 of the 40 pairs, with an average gain of 4.45 points. When applied to a simple baseline, FDC achieves strong overall performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
31 of 40 references.
References · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2019Natural Adversarial Examplescited by 1,401
- 2021Learning to Prompt for Continual Learningcited by 938
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 281
- 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 189
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 178
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 151
- 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
19 more
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2022A Theoretical Study on Solving Continual Learningcited by 78
- 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
- 2025SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learningcited by 60
- 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
- 2022Benchmarking Omni-Vision Representation through the Lens of Visual Realmscited by 38
- 2024MOS: Model Surgery for Pre-Trained Model-Based Class-Incremental Learningcited by 35
- 2025Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learningcited by 19
- 2023Class Incremental Learning via Likelihood Ratio Based Task Predictioncited by 17
- 2025LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learningcited by 16
- 2025RainbowPrompt: Diversity-Enhanced Prompt-Evolving for Continual Learningcited by 10
- 2026Task-Driven Subspace Decomposition for Knowledge Sharing and Isolation in LoRA-based Continual Learningcited by 8
- 2025SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splittingcited by 7
- 2025AnaCP: Toward Upper-Bound Continual Learning via Analytic Contrastive Projectioncited by 7
- 2025PLAN: Proactive Low-Rank Allocation for Continual Learningcited by 5
- 2025T-CIL: Temperature Scaling using Adversarial Perturbation for Calibration in Class-Incremental Learningcited by 4
- 2025Rethinking Continual Learning with Progressive Neural Collapsecited by 4
- 2025Autoencoder-Based Hybrid Replay for Class-Incremental Learningcited by 3
- 2026Revisiting Weight Regularization for Low-Rank Continual Learningcited by 2
Built on by
Not cited yet.