The Diagnosis a Reporter Leaves Unspoken: Surfacing Frozen Tumor Features for Brain-Tumor MRI Reporting
Not on the map. Why?
Abstract (arXiv)
A capable brain-MRI report generator can still be, in effect, diagnostically silent. When a multi-chain chain-of-thought (CoT) reporter built on a medical Mistral-7B backbone is evaluated on held-out cohorts, it names most meningiomas and almost all metastases "glioma" (diagnosis recall 0.44/0.07). Yet the answer is not absent from the model: a supervised linear probe applied to its frozen segmentation features recovers the three tumour cohorts at 0.82 macro-F1 (5-fold cross-validation; chance ≈0.33). We introduce NeuroFusion, an assistive reporter that surfaces this latent signal rather than overriding it: discriminative field-classifier heads over per-lesion features condition a fast, single-pass draft-then-review decoder on their committed outputs. Built on the identical Mistral backbone, this restores the diagnosis (meningioma 0.92, metastasis 0.75) and wins 8 of 9 prose-content comparisons across three held-out cohorts (RaTEScore, RadGraph-F1, GREEN; Holm-corrected paired BCa), with no significant loss on the ninth, at 5-6x lower latency (≈80 vs. 457 s/case). A controlled negative result sharpens the mechanism: a learned diagnosis pin that overrides the decoder instead of merely informing it collapses out-of-distribution metastasis recall to 0.03. Grammar-constrained decoding keeps 92.3% of records schema-valid, making every sentence entailment-checkable (7.5% contradicted vs. 36.8% for the direct baseline). In a blinded nine-case pilot, two board-certified neurologists independently rated NeuroFusion highest in every tumour type, the only system with zero critical errors, and gave it the top-rated sign-off in eight of nine cases (six outright, two ties).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
15 of 25 references.
References · 15
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
- 2017On the Automatic Generation of Medical Imaging Reportscited by 215
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 161
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
- 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 124
- 2024XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Modelscited by 73
3 more
- 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
- 2024AutoRG-Brain: Grounded Report Generation for Brain MRIcited by 23
- 2026Brain3D: Brain Report Automation via Inflated Vision Transformers in 3Dcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026BTReport: A Framework for Brain Tumor Radiology Report Generation with Clinically Relevant Features
- 2026NeuroMosaic: Anatomically Grounded Multimodal Large Language Modeling for Molecularly Aware Glioma Reasoning from 3D MRI and Clinical Narratives
- 2025Computational Imaging Meets LLMs: Zero-Shot IDH Mutation Prediction in Brain Gliomas
- 2026GAZE: Grounded Agentic Zero-shot Evaluation with Viewer-Level Tools and Literature Retrieval on Rare Brain MRI
- 2026Virtual Biopsy for Intracranial Tumors Diagnosis on MRI
- 2026Multimodal Brain Tumour Classification Using Feature Fusion
- 2026A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data
- 2026NeuroVLM-Bench: Evaluation of Vision-Enabled Large Language Models for Clinical Reasoning in Neurological Disorders