mlsanityData to 7 Oct 2026

The Diagnosis a Reporter Leaves Unspoken: Surfacing Frozen Tumor Features for Brain-Tumor MRI Reporting

arXiv 2609.02411 ↗First posted 2 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

A capable brain-MRI report generator can still be, in effect, diagnostically silent. When a multi-chain chain-of-thought (CoT) reporter built on a medical Mistral-7B backbone is evaluated on held-out cohorts, it names most meningiomas and almost all metastases "glioma" (diagnosis recall 0.44/0.07). Yet the answer is not absent from the model: a supervised linear probe applied to its frozen segmentation features recovers the three tumour cohorts at 0.82 macro-F1 (5-fold cross-validation; chance ≈0.33). We introduce NeuroFusion, an assistive reporter that surfaces this latent signal rather than overriding it: discriminative field-classifier heads over per-lesion features condition a fast, single-pass draft-then-review decoder on their committed outputs. Built on the identical Mistral backbone, this restores the diagnosis (meningioma 0.92, metastasis 0.75) and wins 8 of 9 prose-content comparisons across three held-out cohorts (RaTEScore, RadGraph-F1, GREEN; Holm-corrected paired BCa), with no significant loss on the ninth, at 5-6x lower latency (≈80 vs. 457 s/case). A controlled negative result sharpens the mechanism: a learned diagnosis pin that overrides the decoder instead of merely informing it collapses out-of-distribution metastasis recall to 0.03. Grammar-constrained decoding keeps 92.3% of records schema-valid, making every sentence entailment-checkable (7.5% contradicted vs. 36.8% for the direct baseline). In a blinded nine-case pilot, two board-certified neurologists independently rated NeuroFusion highest in every tumour type, the only system with zero critical errors, and gave it the top-rated sign-off in eight of nine cases (six outright, two ties).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

15 of 25 references.

References · 15

  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  3. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  4. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  5. 2017On the Automatic Generation of Medical Imaging Reportscited by 215
  6. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
  7. 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 161
  8. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
  9. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  10. 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
  11. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 124
  12. 2024XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Modelscited by 73
3 more
  1. 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
  2. 2024AutoRG-Brain: Grounded Report Generation for Brain MRIcited by 23
  3. 2026Brain3D: Brain Report Automation via Inflated Vision Transformers in 3Dcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026BTReport: A Framework for Brain Tumor Radiology Report Generation with Clinically Relevant Features
  2. 2026NeuroMosaic: Anatomically Grounded Multimodal Large Language Modeling for Molecularly Aware Glioma Reasoning from 3D MRI and Clinical Narratives
  3. 2025Computational Imaging Meets LLMs: Zero-Shot IDH Mutation Prediction in Brain Gliomas
  4. 2026GAZE: Grounded Agentic Zero-shot Evaluation with Viewer-Level Tools and Literature Retrieval on Rare Brain MRI
  5. 2026Virtual Biopsy for Intracranial Tumors Diagnosis on MRI
  6. 2026Multimodal Brain Tumour Classification Using Feature Fusion
  7. 2026A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data
  8. 2026NeuroVLM-Bench: Evaluation of Vision-Enabled Large Language Models for Clinical Reasoning in Neurological Disorders