mlsanityData to 7 Oct 2026

Compensating Visual Insufficiency with Stratified Language Guidance for Long-Tail Class Incremental Learning

arXiv 2603.21708 ↗First posted 23 Mar 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced data distributions. To tackle these issues, we exploit the informativeness and scalability of language knowledge. Specifically, we analyze the LT CIL data distribution to guide large language models (LLMs) in generating a stratified language tree that hierarchically organizes semantic information from coarse to fine grained granularity. Building upon this structure, we introduce stratified adaptive language guidance, which leverages learnable weights to merge multi-scale semantic representations, thereby enabling dynamic supervisory adjustment for tail classes and alleviating the impact of data imbalance. Furthermore, we introduce stratified alignment language guidance, which exploits the structural stability of the language tree to constrain optimization and reinforce semantic visual alignment, thereby alleviating catastrophic forgetting. Extensive experiments on multiple benchmarks demonstrate that our method achieves state of the art performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

37 of 50 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2016Learning without Forgettingcited by 2,465
  4. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  5. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  6. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
  7. 2021Learning to Prompt for Continual Learningcited by 938
  8. 2019Large Scale Incremental Learningcited by 727
  9. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
  10. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  11. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  12. 2021Deep Long-Tailed Learning: A Surveycited by 416
25 more
  1. 2017Overcoming Catastrophic Forgetting by Incremental Moment Matchingcited by 243
  2. 2018Online Structured Laplace Approximations For Overcoming Catastrophic Forgettingcited by 197
  3. 2021Self-Supervised Models are Continual Learnerscited by 149
  4. 2013Projection onto the probability simplex: An efficient algorithm with a simple proof, and an applicationcited by 65
  5. 2022CLIP model is an Efficient Continual Learnercited by 64
  6. 2022Class-Incremental Learning with Strong Pre-trained Modelscited by 60
  7. 2022Continual evaluation for lifelong learning: Identifying the stability gapcited by 55
  8. 2021Trustworthy Long-Tailed Classificationcited by 51
  9. 2023Introducing Language Guidance in Prompt-based Continual Learningcited by 49
  10. 2024Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusioncited by 47
  11. 2022Long-Tailed Class Incremental Learningcited by 36
  12. 2024Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learnerscited by 35
  13. 2021Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear Connectorcited by 34
  14. 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Contentcited by 33
  15. 2024Generative Multi-modal Models are Good Class-Incremental Learnerscited by 22
  16. 2022Balanced Product of Calibrated Experts for Long-Tailed Recognitioncited by 20
  17. 2022Do Pre-trained Models Benefit Equally in Continual Learning?cited by 20
  18. 2024A Unified and General Framework for Continual Learningcited by 19
  19. 2023Is forgetting less a good inductive bias for forward transfer?cited by 18
  20. 2023Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learningcited by 9
  21. 2024Adaptive Adapter Routing for Long-Tailed Class-Incremental Learningcited by 8
  22. 2024PASS++: A Dual Bias Reduction Framework for Non-Exemplar Class-Incremental Learningcited by 7
  23. 2023Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learningcited by 5
  24. 2025Language-Inspired Relation Transfer for Few-shot Class-Incremental Learningcited by 5
  25. 2024Text-Guided Mixup Towards Long-Tailed Image Categorizationcited by 1

Built on by

Not cited yet.