ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs
Not on the map. Why?
Abstract (arXiv)
Classifying pathological scars from clinical photographs requires distinguishing keloids from hypertrophic scars despite limited expert-labeled data and substantial acquisition variation across hospitals. End-to-end image models remain data-dependent, whereas sending photographs to a hosted vision-language model (VLM) may conflict with local data-governance requirements and yields decisions that are difficult to reproduce and audit. We introduce ScaFE (Scar Feature Engineering), which transfers clinical knowledge from a large language model (LLM) into deterministic, executable feature programs instead of asking the model to diagnose images. A web-enabled LLM retrieves clinical evidence and synthesizes programs that measure visually assessable scar attributes. Candidate programs execute in a restricted local environment, and only aggregate validation statistics and feature-level SHAP summaries are returned for iterative repair and refinement; raw images and patient-level outputs remain local. A lightweight Random Forest then operates on the resulting structured representation. On 600 photographs from three hospitals under leave-one-site-out evaluation, ScaFE achieves 81.0% site-macro balanced accuracy, exceeding the strongest baseline, BiomedCLIP, by 10.0 percentage points. With only 10% of the development data, ScaFE retains 72.0% balanced accuracy and an 11.8-point lead. Iterative refinement also raises the executable-program rate from 66.7% to 95.0%, with verified evidence for 91.7% of the final features. These results show that LLM knowledge can support data-efficient, cross-site medical image classification through local and auditable feature programs rather than direct VLM decisions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
11 of 22 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2020Concept Bottleneck Modelscited by 1,032
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 50
- 2024PTaRL: Prototype-based Tabular Representation Learning via Space Calibrationcited by 28
- 2025Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatologycited by 28
- 2023Multimodal Foundation Models Exploit Text to Make Medical Image Predictionscited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification
- 2025Leveraging Foundation Models for Histological Grading in Cutaneous Squamous Cell Carcinoma using PathFMTools
- 2026DermaFlux: Synthetic Skin Lesion Generation with Rectified Flows for Enhanced Image Classification
- 2024Benchmarking foundation models as feature extractors for weakly-supervised computational pathology
- 2023Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models
- 2026SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification
- 2026Visual concept ranking uncovers medical shortcuts used by large multimodal models
- 2026LUTSeg: A Longitudinal Multi-Expert Dataset for Ulcer Tissue Segmentation