In-Context Learning for Wound Classification with Small Multimodal Language Models
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Wound image classification is often treated as a task-specific supervised learning problem, requiring substantial amounts of manually labelled data and retraining when the label space or deployment setting changes. This study evaluated whether small multimodal language models (SMLMs) can provide a training-free alternative for wound classification through retrieval-based in-context learning (ICL). Experiments used two public wound-image datasets: the Kaggle wound dataset (1469 images, 10 classes) and the Medetec dataset (560 images, 9 classes). Eleven SMLMs from the Qwen 3.5, Ministral 3, and Gemma 4 families were evaluated under zero-shot prompting and few-shot prompting with random support examples, embedding-based k-nearest-neighbour (kNN) retrieval, and kNN retrieval followed by maximal marginal relevance reranking (MMR). Retrieval-only weighted-kNN controls, support-set reduction experiments, and support-context size sweeps were used to assess the effects of retrieval, model scale, and prompt length. Query-conditioned ICL consistently outperformed zero-shot and random few-shot prompting. On the Kaggle dataset, the best result was achieved by Qwen 3.5 27B with kNN+MMR, reaching 0.872 accuracy and 0.871 F1 score. On Medetec, Qwen 3.5 27B with kNN+MMR reached 0.678 accuracy and 0.670 F1. Larger models exceeded matched weighted-kNN controls, indicating use of retrieved examples beyond nearest-neighbour voting. Retrieval-based ICL degraded modestly under support-set reduction, and most gains saturated with 8-10 support images. Retrieval-based ICL allows SMLMs to perform adaptable wound image classification without task-specific retraining. Compact retrieved contexts may support practical and privacy-conscious deployment, although performance remains dependent on model scale, retrieval strategy, and dataset difficulty.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 56 of its 84 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
56 of 84 references.
Closest ancestors · 1
Same direction, newest first
- 2024In-context learning enables multimodal large language models to classify cancer pathology images12 Mar
Other references · 55
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022A ConvNet for the 2020scited by 3,579
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
38 more
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2025DINOv3cited by 1,414
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 661
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
- 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2026Ministral 3cited by 114
- 2024Small Language Models: Survey, Measurements, and Insightscited by 112
- 2024On-Device Language Models: A Comprehensive Reviewcited by 104
- 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 76
- 2024Many-Shot In-Context Learning in Multimodal Foundation Modelscited by 67
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 35
- 2023Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?cited by 34
- 2023How to Configure Good In-Context Sequence for Visual Question Answeringcited by 33
- 2023Evaluating General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarkscited by 33
- 2020Fully Automatic Wound Segmentation with Deep Convolutional Neural Networkscited by 32
- 2024A Survey of Small Language Modelscited by 31
- 2024Prompt Leakage effect and defense strategies for multi-turn LLM interactionscited by 23
- 2024An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Modelscited by 22
- 2019Recognition of Ischaemia and Infection in Diabetic Foot Ulcers: Dataset and Techniquescited by 19
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directionscited by 18
- 2025The Rise of Small Language Models in Healthcare: A Comprehensive Surveycited by 18
- 2024How Does the Textual Information Affect the Retrieval of Multimodal In-Context Learning?cited by 13
- 2024Visual Prompt Selection for In-Context Learning Segmentationcited by 13
- 2021Detect-and-Segment: a Deep Learning Approach to Automate Wound Image Segmentationcited by 12
- 2025Exploring the Role of Diversity in Example Selection for In-Context Learningcited by 12
- 2020Image Based Artificial Intelligence in Wound Assessment: A Systematic Reviewcited by 11
- 2021Multi-modal Wound Classification using Wound Image and Location by Deep Neural Networkcited by 10
- 2024Deep learning with noisy labels in medical prediction problems: a scoping reviewcited by 10
- 2020Multiclass Wound Image Classification using an Ensemble Deep CNN-based Classifiercited by 9
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Retrieval-augmented in-context learning for multimodal large language models in disease classification
- 2026Infection-Reasoner: A Compact Vision-Language Model for Wound Infection Classification with Evidence-Grounded Clinical Reasoning
- 2025SMMILE: An Expert-Driven Benchmark for Multimodal Medical In-Context Learning
- 2025Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQA
- 2026Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring
- 2026Representation-guided in-context learning for medical image interpretation with multimodal large language models
- 2026LLM is Not All You Need: A Systematic Evaluation of ML vs. Foundation Models for text and image based Medical Classification
- 2024Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity