mlsanityData to 7 Oct 2026

Semantically Calibrated Evidence Composition for CT Vision-Language Learning

arXiv 2608.00239 ↗First posted 31 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning transferable representations from CT-report pairs requires combining whole-volume context with anatomy-specific evidence. Existing methods typically emphasize either global CT-report alignment or fine-grained anatomy-level correspondence. Global alignment preserves broad study context but leaves the contribution of localized evidence implicit, whereas anatomy-level alignment explicitly grounds local findings but does not specify how independently represented evidence should interact, acquire study-level meaning, and contribute to a global CT representation. To address this gap, we propose SCOPE (Semantic Calibration Of comPosed Evidence), a framework for semantically calibrated evidence composition in CT vision-language learning. Under organ-specific report supervision, mask-guided queries with fixed anatomical identities extract context-aware organ evidence from shared, uncropped volumetric features, while an unrestricted global query retains access to whole-volume context. The global query then drives Local-Global Coupling to compose the organ evidence into a unified evidence representation. The composed evidence is subsequently calibrated using the diagnostic summary, providing study-level semantic supervision beyond local organ descriptions, and is finally integrated as a controlled residual into a context-preserving whole-volume representation aligned with the complete report. This progressive pathway connects localized evidence with study-level semantics without reducing the CT representation to a predefined set of organs. On CT-RATE and RadChestCT, SCOPE achieves macro AUCs of 85.0 and 72.2, respectively, outperforming the previous SOTA by 7.2 and 4.2, while also yielding substantial gains in linear probing and cross-modal retrieval. These results demonstrate the effectiveness of semantically calibrated evidence composition.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

19 of 30 references.

References · 19

  1. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
  2. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  3. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  4. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
  5. 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
  6. 2021Joint Learning of Localized Representations from Medical Images and Reportscited by 81
  7. 2021Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reportscited by 80
  8. 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 66
  9. 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understandingcited by 53
  10. 2022Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledgecited by 51
  11. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  12. 2025Vision Foundation Models for Computed Tomographycited by 44
7 more
  1. 2021Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answeringcited by 26
  2. 2024Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Modelscited by 24
  3. 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 20
  4. 2023T3D: Advancing 3D Medical Vision-Language Pre-training by Learning Multi-View Visual Consistencycited by 14
  5. 2025Curia: A Multi-Modal Foundation Model for Radiologycited by 14
  6. 2024Intensity Confusion Matters: An Intensity-Distance Guided Loss for Bronchus Segmentationcited by 6
  7. 2022BCNet: Bronchus Classification via Structure Guided Representation Learningcited by 5

Built on by

Not cited yet.