Compensating Visual Insufficiency with Stratified Language Guidance for Long-Tail Class Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced data distributions. To tackle these issues, we exploit the informativeness and scalability of language knowledge. Specifically, we analyze the LT CIL data distribution to guide large language models (LLMs) in generating a stratified language tree that hierarchically organizes semantic information from coarse to fine grained granularity. Building upon this structure, we introduce stratified adaptive language guidance, which leverages learnable weights to merge multi-scale semantic representations, thereby enabling dynamic supervisory adjustment for tail classes and alleviating the impact of data imbalance. Furthermore, we introduce stratified alignment language guidance, which exploits the structural stability of the language tree to constrain optimization and reinforce semantic visual alignment, thereby alleviating catastrophic forgetting. Extensive experiments on multiple benchmarks demonstrate that our method achieves state of the art performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
37 of 50 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Learning without Forgettingcited by 2,465
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
- 2021Learning to Prompt for Continual Learningcited by 938
- 2019Large Scale Incremental Learningcited by 727
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2021Deep Long-Tailed Learning: A Surveycited by 416
25 more
- 2017Overcoming Catastrophic Forgetting by Incremental Moment Matchingcited by 243
- 2018Online Structured Laplace Approximations For Overcoming Catastrophic Forgettingcited by 197
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2013Projection onto the probability simplex: An efficient algorithm with a simple proof, and an applicationcited by 65
- 2022CLIP model is an Efficient Continual Learnercited by 64
- 2022Class-Incremental Learning with Strong Pre-trained Modelscited by 60
- 2022Continual evaluation for lifelong learning: Identifying the stability gapcited by 55
- 2021Trustworthy Long-Tailed Classificationcited by 51
- 2023Introducing Language Guidance in Prompt-based Continual Learningcited by 49
- 2024Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusioncited by 47
- 2022Long-Tailed Class Incremental Learningcited by 36
- 2024Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learnerscited by 35
- 2021Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear Connectorcited by 34
- 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Contentcited by 33
- 2024Generative Multi-modal Models are Good Class-Incremental Learnerscited by 22
- 2022Balanced Product of Calibrated Experts for Long-Tailed Recognitioncited by 20
- 2022Do Pre-trained Models Benefit Equally in Continual Learning?cited by 20
- 2024A Unified and General Framework for Continual Learningcited by 19
- 2023Is forgetting less a good inductive bias for forward transfer?cited by 18
- 2023Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learningcited by 9
- 2024Adaptive Adapter Routing for Long-Tailed Class-Incremental Learningcited by 8
- 2024PASS++: A Dual Bias Reduction Framework for Non-Exemplar Class-Incremental Learningcited by 7
- 2023Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learningcited by 5
- 2025Language-Inspired Relation Transfer for Few-shot Class-Incremental Learningcited by 5
- 2024Text-Guided Mixup Towards Long-Tailed Image Categorizationcited by 1
Built on by
Not cited yet.