MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretraining
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Medical vision-language pretraining increasingly relies on medical reports as large-scale supervisory signals; however, raw reports often exhibit substantial stylistic heterogeneity, variable length, and a considerable amount of image-irrelevant content. Although text normalization is frequently adopted as a preprocessing step in prior work, its design principles and empirical impact on vision-language pretraining remain insufficiently and systematically examined. In this study, we present MedTri, a deployable normalization framework for medical vision-language pretraining that converts free-text reports into a unified [Anatomical Entity: Radiologic Description + Diagnosis Category] triplet. This structured, anatomy-grounded normalization preserves essential morphological and spatial information while removing stylistic noise and image-irrelevant content, providing consistent and image-grounded textual supervision at scale. Across multiple datasets spanning both X-ray and computed tomography (CT) modalities, we demonstrate that structured, anatomy-grounded text normalization is an important factor in medical vision-language pretraining quality, yielding consistent improvements over raw reports and existing normalization baselines. In addition, we illustrate how this normalization can easily support modular text-level augmentation strategies, including knowledge enrichment and anatomy-grounded counterfactual supervision, which provide complementary gains in robustness and generalization without altering the core normalization process. Together, our results position structured text normalization as a critical and generalizable preprocessing component for medical vision-language learning, while MedTri provides this normalization platform. Code and data will be released at https://github.com/Arturia-Pendragon-Iris/MedTri.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 30 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
20 of 30 references.
Closest ancestors · 1
Same direction, newest first
Other references · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Modelcited by 83
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
- 2024CT-GLIP: 3D Grounded Language-Image Pretraining with CT Scans and Radiology Reports for Full-Body Scenarioscited by 29
- 2023INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosiscited by 24
- 2024Reassessing Layer Pruning in LLMs: New Insights and Methodscited by 23
- 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judgescited by 23
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Datasetcited by 21
7 more
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2025From Points to Coalitions: Hierarchical Contrastive Shapley Values for Prioritizing Data Samplescited by 12
- 2025DSPC: Dual-Stage Progressive Compression Framework for Efficient Long-Context Reasoningcited by 9
- 2024Improving Representation of High-frequency Components for Medical Visual Foundation Modelscited by 8
- 2025From LLM-anation to LLM-orchestrator: Coordinating Small Models for Data Labelingcited by 8
- 2024Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samplescited by 6
- 2025PARROT: An Open Multilingual Radiology Reports Datasetcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?
- 2024Anatomical Structure-Guided Medical Vision-Language Pre-training
- 2026Clinical Trajectory Alignment for Medical Vision-Language Pre-training
- 2026Learning to Read Where to Look: Disease-Aware Vision-Language Pretraining for 3D CT
- 2026MApLe: Multi-instance Alignment of Diagnostic Reports and Large Medical Images
- 2025Distribution-Based Masked Medical Vision-Language Model Using Structured Reports
- 2023IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training
- 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias