Semantically Calibrated Evidence Composition for CT Vision-Language Learning
Not on the map. Why?
Abstract (arXiv)
Learning transferable representations from CT-report pairs requires combining whole-volume context with anatomy-specific evidence. Existing methods typically emphasize either global CT-report alignment or fine-grained anatomy-level correspondence. Global alignment preserves broad study context but leaves the contribution of localized evidence implicit, whereas anatomy-level alignment explicitly grounds local findings but does not specify how independently represented evidence should interact, acquire study-level meaning, and contribute to a global CT representation. To address this gap, we propose SCOPE (Semantic Calibration Of comPosed Evidence), a framework for semantically calibrated evidence composition in CT vision-language learning. Under organ-specific report supervision, mask-guided queries with fixed anatomical identities extract context-aware organ evidence from shared, uncropped volumetric features, while an unrestricted global query retains access to whole-volume context. The global query then drives Local-Global Coupling to compose the organ evidence into a unified evidence representation. The composed evidence is subsequently calibrated using the diagnostic summary, providing study-level semantic supervision beyond local organ descriptions, and is finally integrated as a controlled residual into a context-preserving whole-volume representation aligned with the complete report. This progressive pathway connects localized evidence with study-level semantics without reducing the CT representation to a predefined set of organs. On CT-RATE and RadChestCT, SCOPE achieves macro AUCs of 85.0 and 72.2, respectively, outperforming the previous SOTA by 7.2 and 4.2, while also yielding substantial gains in linear probing and cross-modal retrieval. These results demonstrate the effectiveness of semantically calibrated evidence composition.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
19 of 30 references.
References · 19
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
- 2021Joint Learning of Localized Representations from Medical Images and Reportscited by 81
- 2021Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reportscited by 80
- 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 66
- 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understandingcited by 53
- 2022Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledgecited by 51
- 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
- 2025Vision Foundation Models for Computed Tomographycited by 44
7 more
- 2021Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answeringcited by 26
- 2024Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Modelscited by 24
- 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 20
- 2023T3D: Advancing 3D Medical Vision-Language Pre-training by Learning Multi-View Visual Consistencycited by 14
- 2025Curia: A Multi-Modal Foundation Model for Radiologycited by 14
- 2024Intensity Confusion Matters: An Intensity-Distance Guided Loss for Bronchus Segmentationcited by 6
- 2022BCNet: Bronchus Classification via Structure Guided Representation Learningcited by 5
Built on by
Not cited yet.