CUE: Concept-Aware Multi-Label Expansion to Mitigate Concept Confusion in Long-Tailed Learning
Not on the map. Why?
Abstract (arXiv)
Long-tailed distributions are common in real-world recognition tasks, where a few head classes have many samples while most tail classes have very few. Recently, fine-tuning foundation models for long-tailed learning has gained attention due to their excellent performance. However, most existing methods focus solely on mitigating long-tailed distribution bias while overlooking concept confusion caused by the long-tailed distribution. In this paper, we study this problem and attribute it to the mutual exclusivity of single-label supervision under long-tailed distributions, which suppresses feature sharing among related classes and amplifies the dominance of head classes, leading to disrupted inter-class discriminability. To address this, we propose CUE, Concept-aware mUlti-label Expansion, which introduces multi-label concept signals to preserve disrupted inter-class relationships. Specifically, CUE constructs concept sets by (i) extracting instance-level visual cues from zero-shot CLIP and (ii) generating class-level semantic cues with LLM; the two cues are incorporated via separately weighted Binary Logit-Adjustment (BLA) auxiliary losses and jointly optimized with the baseline Logit-Adjustment (LA) loss. Experiments on several long-tailed benchmarks, CUE achieves balanced and strong performance, surpassing recent state-of-the-art methods. Code is available at: https://github.com/zhangruichi/CUE.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
38 of 51 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2022Visual Prompt Tuningcited by 1,681
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
26 more
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2020Long-tail learning via logit adjustmentcited by 618
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2021Distribution Alignment: A Unified Framework for Long-tail Visual Recognitioncited by 198
- 2020Disentangling Label Distribution for Long-tailed Visual Recognitioncited by 172
- 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
- 2022Retrieval Augmented Classification for Long-Tail Visual Recognitioncited by 106
- 2021ResLT: Residual Learning for Long-tailed Recognitioncited by 96
- 2022Debiased Learning from Naturally Imbalanced Pseudo-Labelscited by 85
- 2023Long-tailed Visual Recognition via Gaussian Clouded Logit Adjustmentcited by 75
- 2022LPT: Long-tailed Prompt Tuning for Image Classificationcited by 69
- 2021SimPLE: Similar Pseudo Label Exploitation for Semi-Supervised Classificationcited by 68
- 2021VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognitioncited by 65
- 2023Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurtscited by 58
- 2021A Simple Long-Tailed Recognition Baseline via Vision-Language Modelcited by 49
- 2023CDUL: CLIP-Driven Unsupervised Learning for Multi-Label Image Classificationcited by 39
- 2023How Re-sampling Helps for Long-Tail Learning?cited by 36
- 2023Exploring Vision-Language Models for Imbalanced Learningcited by 35
- 2022Learning Imbalanced Data with Vision Transformerscited by 34
- 2024A Systematic Review on Long-Tailed Learningcited by 28
- 2024Adapters Strike Backcited by 16
- 2024Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognitioncited by 16
- 2023LMPT: Prompt Tuning with Class-Specific Embedding Loss for Long-tailed Multi-Label Visual Recognitioncited by 15
- 2024Improving Visual Prompt Tuning by Gaussian Neighborhood Minimization for Long-Tailed Visual Recognitioncited by 15
- 2025Long-tailed Recognition with Model Rebalancingcited by 10
- 2025LIFT+: Lightweight Fine-Tuning for Long-Tail Learningcited by 5
Built on by
Not cited yet.