mlsanityData to 14 Oct 2026

HyCal: A Training-Free Prototype Calibration Method for Cross-Discipline Few-Shot Class-Incremental Learning

arXiv 2604.15678 ↗First posted 17 Apr 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Prompt learning and adaptation of CLIP

Abstract (arXiv)

Pretrained Vision-Language Models (VLMs) like CLIP show promise in continual learning, but existing Few-Shot Class-Incremental Learning (FSCIL) methods assume homogeneous domains and balanced data distributions, limiting real-world applicability where data arises from heterogeneous disciplines with imbalanced sample availability and varying visual complexity. We identify Domain Gravity, a representational asymmetry where data imbalance across heterogeneous domains causes overrepresented or low-entropy domains to disproportionately influence the embedding space, leading to prototype drift and degraded performance on underrepresented or high-entropy domains. To address this, we introduce Cross-Discipline Variable Few-Shot Class-Incremental Learning (XD-VSCIL), a benchmark capturing real-world heterogeneity and imbalance where Domain Gravity naturally intensifies. We propose Hybrid Prototype Calibration (HyCal), a training-free method combining cosine similarity and Mahalanobis distance to capture complementary geometric properties-directional alignment and covariance-aware magnitude-yielding stable prototypes under imbalanced heterogeneous conditions. Operating on frozen CLIP embeddings, HyCal achieves consistent retention-adaptation improvements while maintaining efficiency. Experiments show HyCal effectively mitigates Domain Gravity and outperforms existing methods in imbalanced cross-domain incremental learning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompt learning and adaptation of CLIP, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 38 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

29 of 38 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025LADA: Scalable Label-Specific CLIP Adapter for Continual Learning29 May
  2. 2024Advancing Cross-domain Discriminability in Continual Learning of Vision-Language Models27 Jun
  3. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters18 Mar
  4. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapters9 Oct
  5. 2021Learning to Prompt for Vision-Language Models2 Sep

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2013Describing Textures in the Wildcited by 2,125
  4. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  5. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  6. 2020Few-Shot Class-Incremental Learningcited by 251
  7. 2023Class-Incremental Learning: A Surveycited by 209
  8. 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
  9. 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
  10. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 164
  11. 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 87
  12. 2022The ArtBench Dataset: Benchmarking Generative Models with Artworkscited by 64
12 more
  1. 2024The Double-Ellipsoid Geometry of CLIPcited by 42
  2. 2025Beyond Semantics: Rediscovering Spatial Awareness in Vision-Language Modelscited by 37
  3. 2024MOS: Model Surgery for Pre-Trained Model-Based Class-Incremental Learningcited by 36
  4. 2025Interpreting the linear structure of vision-language model embedding spacescited by 32
  5. 2023Understanding the Feature Norm for Out-of-Distribution Detectioncited by 27
  6. 2024Continual Learning Using a Kernel-Based Method Over Foundation Modelscited by 14
  7. 2024What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insightscited by 13
  8. 2024Calibrating Higher-Order Statistics for Few-Shot Class-Incremental Learning with Pre-trained Vision Transformerscited by 9
  9. 2024Dynamically Anchored Prompting for Task-Imbalanced Continual Learningcited by 6
  10. 2023Online Continual Learning via Logit Adjusted Softmaxcited by 5
  11. 2024Defying Imbalanced Forgetting in Class Incremental Learningcited by 4
  12. 2024PIP: Prototypes-Injected Prompt for Federated Class Incremental Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024PromptSync: Bridging Domain Gaps in Vision-Language Models through Class-Aware Prototype Alignment and Discrimination
  2. 2024A streamlined Approach to Multimodal Few-Shot Class Incremental Learning for Fine-Grained Datasets
  3. 2026PRiSM: Prototype Regularization for Few-Shot VLMs
  4. 2026Visual Branch is What You Need for CLIP-based Class-Incremental Learning
  5. 2025Preserving Cross-Modal Consistency for CLIP-based Class-Incremental Learning
  6. 2025Representation Calibration and Uncertainty Guidance for Class-Incremental Learning based on Vision Language Model
  7. 2025Class-Aware Prototype Learning with Negative Contrast for Test-Time Adaptation of Vision-Language Models
  8. 2026Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning