mlsanityData to 14 Oct 2026

CUE: Concept-Aware Multi-Label Expansion to Mitigate Concept Confusion in Long-Tailed Learning

arXiv 2605.01309 ↗First posted 2 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-tailed distributions are common in real-world recognition tasks, where a few head classes have many samples while most tail classes have very few. Recently, fine-tuning foundation models for long-tailed learning has gained attention due to their excellent performance. However, most existing methods focus solely on mitigating long-tailed distribution bias while overlooking concept confusion caused by the long-tailed distribution. In this paper, we study this problem and attribute it to the mutual exclusivity of single-label supervision under long-tailed distributions, which suppresses feature sharing among related classes and amplifies the dominance of head classes, leading to disrupted inter-class discriminability. To address this, we propose CUE, Concept-aware mUlti-label Expansion, which introduces multi-label concept signals to preserve disrupted inter-class relationships. Specifically, CUE constructs concept sets by (i) extracting instance-level visual cues from zero-shot CLIP and (ii) generating class-level semantic cues with LLM; the two cues are incorporated via separately weighted Binary Logit-Adjustment (BLA) auxiliary losses and jointly optimized with the baseline Logit-Adjustment (LA) loss. Experiments on several long-tailed benchmarks, CUE achieves balanced and strong performance, surpassing recent state-of-the-art methods. Code is available at: https://github.com/zhangruichi/CUE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

38 of 51 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  7. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  8. 2022Visual Prompt Tuningcited by 1,681
  9. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  10. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  11. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
  12. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
26 more
  1. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
  2. 2020Long-tail learning via logit adjustmentcited by 618
  3. 2021Deep Long-Tailed Learning: A Surveycited by 417
  4. 2021Distribution Alignment: A Unified Framework for Long-tail Visual Recognitioncited by 198
  5. 2020Disentangling Label Distribution for Long-tailed Visual Recognitioncited by 172
  6. 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
  7. 2022Retrieval Augmented Classification for Long-Tail Visual Recognitioncited by 106
  8. 2021ResLT: Residual Learning for Long-tailed Recognitioncited by 96
  9. 2022Debiased Learning from Naturally Imbalanced Pseudo-Labelscited by 85
  10. 2023Long-tailed Visual Recognition via Gaussian Clouded Logit Adjustmentcited by 75
  11. 2022LPT: Long-tailed Prompt Tuning for Image Classificationcited by 69
  12. 2021SimPLE: Similar Pseudo Label Exploitation for Semi-Supervised Classificationcited by 68
  13. 2021VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognitioncited by 65
  14. 2023Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurtscited by 58
  15. 2021A Simple Long-Tailed Recognition Baseline via Vision-Language Modelcited by 49
  16. 2023CDUL: CLIP-Driven Unsupervised Learning for Multi-Label Image Classificationcited by 39
  17. 2023How Re-sampling Helps for Long-Tail Learning?cited by 36
  18. 2023Exploring Vision-Language Models for Imbalanced Learningcited by 35
  19. 2022Learning Imbalanced Data with Vision Transformerscited by 34
  20. 2024A Systematic Review on Long-Tailed Learningcited by 28
  21. 2024Adapters Strike Backcited by 16
  22. 2024Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognitioncited by 16
  23. 2023LMPT: Prompt Tuning with Class-Specific Embedding Loss for Long-tailed Multi-Label Visual Recognitioncited by 15
  24. 2024Improving Visual Prompt Tuning by Gaussian Neighborhood Minimization for Long-Tailed Visual Recognitioncited by 15
  25. 2025Long-tailed Recognition with Model Rebalancingcited by 10
  26. 2025LIFT+: Lightweight Fine-Tuning for Long-Tail Learningcited by 5

Built on by

Not cited yet.