mlsanityData to 7 Oct 2026

Multi-View Synergistic Learning with Vision-Language Adaption for Low-Resource Biomedical Image Classification

arXiv 2604.23977 ↗First posted 27 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising foundation for mitigating data scarcity, their effective adaptation in biomedical settings is constrained by the need for parameter-efficient tuning alongside fine-grained and semantically consistent representation learning. In this work, we propose Multi-View Synergistic Learning (MVSL), a unified framework that addresses these challenges by jointly considering adaptation paradigms, representation granularity, and disease semantic relationships. MVSL decouples the adaptation of visual and textual encoders to respect their distinct representational characteristics, enabling more stable and effective parameter-efficient fine-tuning. It further introduces multi-granularity contrastive learning to explicitly model both global image semantics and localized lesion-level evidence, improving fine-grained discrimination for visually similar disease categories. In addition, MVSL preserves disease-level semantic structure by incorporating structured supervision derived from large language models, which constrains textual representations at the class level and indirectly regularizes visual embeddings through cross-modal alignment. Together, these components enable more stable cross-modal alignment and improved discrimination under limited supervision. Extensive experiments on 11 public biomedical datasets spanning 9 imaging modalities and 10 anatomical regions demonstrate that MVSL consistently outperforms state-of-the-art methods in few-shot and zero-shot classification settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 62 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

30 of 62 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  4. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  5. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
  6. 2022MaPLe: Multi-modal Prompt Learningcited by 685
  7. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
  8. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
  9. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
  10. 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 429
  11. 2022Prompt-aligned Gradient for Prompt Tuningcited by 339
  12. 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 307
18 more
  1. 2023Self-regulating Prompts: Foundational Model Adaptation without Forgettingcited by 272
  2. 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
  3. 2022Prompt Distribution Learningcited by 235
  4. 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
  5. 2024Low-Rank Few-Shot Adaptation of Vision-Language Modelscited by 103
  6. 2023A Closer Look at the Few-Shot Adaptation of Large Vision-Language Modelscited by 67
  7. 2024LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIPcited by 60
  8. 2022Bayesian Prompt Learning for Image-Language Model Generalizationcited by 51
  9. 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptationcited by 51
  10. 2021COVID-19 Infection Localization and Severity Grading from Chest X-ray Imagescited by 46
  11. 2021PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Maskcited by 31
  12. 2024BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Modelscited by 28
  13. 2023Domain-Controlled Prompt Learningcited by 22
  14. 2024XCoOp: Explainable Prompt Learning for Computer-Aided Diagnosis via Concept-guided Context Optimizationcited by 20
  15. 2025ProKeR: A Kernel Perspective on Few-Shot Adaptation of Large Vision-Language Modelscited by 15
  16. 2023Correspondence-Free Domain Alignment for Unsupervised Cross-Domain Image Retrievalcited by 11
  17. 2024Aligning Medical Images with General Knowledge from Large Language Modelscited by 7
  18. 2025Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrievalcited by 1

Built on by

Not cited yet.