mlsanityData to 14 Oct 2026

DS@GT ARC at MEDIQA-CORE-Task-1 2026: Trimodal Model Fusion with Task-Specific Gates for Brain Tumor Subtype Classification

arXiv 2608.00086 ↗First posted 30 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain tumor diagnosis is a time-sensitive process in which patients may wait weeks for a finalized pathology report. This problem motivates automated systems that classify tumor subtype from multimodal inputs. This paper details the DS@GT ARC team's work for ImageCLEFmed MEDIQA-CORE 2026 Task~1, Brain Tumor Subtype Classification. The task evaluates three glioma classification problems: Level-1 Molecular Type, LGG vs HGG, and WHO Grade. We combine pre-extracted MRI (NeuroVFM) and histopathology (Prov-GigaPath) embeddings with free-text radiology reports. Our team explored two trimodal fusion architectures, two report encoders (RadBERT and Llama-3.1-8B-Instruct), and a biologically motivated post-processing stage. We achieve a mean macro-F1 of 0.801 under the Fully Multimodal condition, exceeding the organizers' baseline of 0.796 and ranking second among the teams whose code passed verification. Additional evaluation across modality-dropping conditions shows that this advantage depends heavily on the availability of the histopathology modality, and that our system falls behind the baseline when modalities are missing. Our code is available on GitHub at https://github.com/dsgt-arc/imageclef-mediqacore-2026.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 30 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

10 of 30 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 179
  5. 2016HeMIS: Hetero-Modal Image Segmentationcited by 103
  6. 2021ACN: Adversarial Co-training Network for Brain Tumor Segmentation with Missing Modalitiescited by 43
  7. 2020Modality Dropout for Improved Performance-driven Talking Facescited by 32
  8. 2025Learning Contrastive Multimodal Fusion with Improved Modality Dropout for Disease Detection and Predictioncited by 6
  9. 2025Health system learning achieves generalist neuroimaging modelscited by 6
  10. 2026CoRe-BT: A Multimodal Radiology-Pathology-Text Benchmark for Robust Brain Tumor Typingcited by 3

Built on by

Not cited yet.