DS@GT ARC at ImageCLEFmedical 2026: Architectural Diversity for Concept Detection and Foundation-Model Scaling for Caption Prediction in Medical Image Analysis
Not on the map. Why?
Abstract (arXiv)
We describe the DS@GT submissions to the ImageCLEFmedical Caption 2026 challenge, which continues a long-running benchmark on the ROCOv2 dataset with two tracks: Concept Detection (Task 1), assigning UMLS Concept Unique Identifiers (CUIs) to radiology images, and Caption Prediction (Task 2), generating natural-language captions. For Task 1, our primary submission was a three-way late-fusion ensemble of ConvNeXt-V2, BiomedCLIP ViT-B/16, and DenseNet-169 with a regularized ''Honest Threshold Tuning'' procedure designed to avoid validation overfitting on rare concepts; this submission ranked first on the official submission with a primary F1 of 0.5790 and a secondary F1 of 0.9657. In parallel, we submitted a training-free KNN retrieval pipeline over frozen BiomedCLIP embeddings, which reached a primary F1 of 0.5780 and a secondary F1 of 0.9599-essentially matching the fine-tuned ensemble on the primary track at a fraction of the cost. For Task 2, our submissions included a fine-tuned Gemma-3 27B model (overall 0.3571, ranking third in the official submission), a fully fine-tuned BLIP pipeline with custom Vizwins merging (0.3564), and a zero-shot MedGemma-4B run with a PubMed-style prompt (0.3186), spanning a wide range of model scales and training costs. Code: https://github.com/dsgt-arc/imageclef-caption-2026.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
18 of 36 references.
References · 18
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022A ConvNet for the 2020scited by 3,579
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2024The Platonic Representation Hypothesiscited by 382
6 more
- 2020Asymmetric Loss For Multi-Label Classificationcited by 381
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 185
- 2025Harnessing the Universal Geometry of Embeddingscited by 55
- 2024ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Datasetcited by 54
- 2025Your other Left! Vision-Language Models Fail to Identify Relative Positions in Medical Imagescited by 13
- 2025Anomaly Detection by Clustering DINO Embeddings using a Dirichlet Process Mixturecited by 5
Built on by
Not cited yet.