mlsanityData to 14 Oct 2026

Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts

arXiv 2506.04673 ↗First posted 5 Jun 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to suboptimal performance.To address this limitation, we propose a Few-Shot Prototypical Concept Classification (FSPCC) framework that systematically mitigates two key challenges under low-data regimes: parametric imbalance and representation misalignment. Specifically, our approach leverages a Mixture of LoRA Experts (MoLE) for parameter-efficient adaptation, ensuring a balanced allocation of trainable parameters between the backbone and the PCL module.Meanwhile, cross-module concept guidance enforces tight alignment between the backbone's feature representations and the prototypical concept activation patterns.In addition, we incorporate a multi-level feature preservation strategy that fuses spatial and semantic cues across various layers, thereby enriching the learned representations and mitigating the challenges posed by limited data availability.Finally, to enhance interpretability and minimize concept overlap, we introduce a geometry-aware concept discrimination loss that enforces orthogonality among concepts, encouraging more disentangled and transparent decision boundaries.Experimental results on six popular benchmarks (CUB-200-2011, mini-ImageNet, CIFAR-FS, Stanford Cars, FGVC-Aircraft, and DTD) demonstrate that our approach consistently outperforms existing SEMs by a notable margin, with 4.2%-8.7% relative gains in 5-way 5-shot classification.These findings highlight the efficacy of coupling concept learning with few-shot adaptation to achieve both higher accuracy and clearer model interpretability, paving the way for more transparent visual recognition systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

33 of 48 references.

References · 33

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  9. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  10. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  11. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  12. 2016Matching Networks for One Shot Learningcited by 2,255
21 more
  1. 2013Describing Textures in the Wildcited by 2,125
  2. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  3. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  4. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  5. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  6. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
  7. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  8. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
  9. 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 431
  10. 2018Meta-learning with differentiable closed-form solverscited by 397
  11. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
  12. 2022Prompt-aligned Gradient for Prompt Tuningcited by 341
  13. 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 308
  14. 2022Task Residual for Tuning Vision-Language Modelscited by 123
  15. 2023Sparse Low-rank Adaptation of Pre-trained Language Modelscited by 96
  16. 2018Few-Shot Learning with Metric-Agnostic Conditional Embeddingscited by 40
  17. 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
  18. 2023Adaptive Gating in Mixture-of-Experts based Language Modelscited by 16
  19. 2022Joint Answering and Explanation for Visual Commonsense Reasoningcited by 11
  20. 2024ProtoS-ViT: Visual foundation models for sparse self-explainable classificationscited by 8
  21. 2023Learning Transferable Conceptual Prototypes for Interpretable Unsupervised Domain Adaptationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.