mlsanityData to 14 Oct 2026

MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter

arXiv 2608.16709 ↗First posted 17 Aug 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

A radiologist reading a model's output faces two problems. The model returns a number and no reason, and any system that turns that number into readable prose can quietly add claims the model never made. MIRROR is a research prototype built to separate those failures. It chains a multi-label classifier, a Grad-CAM localizer that turns each positive finding into a named anatomical region, and a report writer that receives the labels, probabilities, and regions but never the image. Because the language layer cannot see pixels, it cannot assert a finding the classifier did not make. We are precise about what that buys: a MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text, and we show one stating a cardiothoracic ratio the system never measured. One registry holds the taxonomy, anatomy, and phrasing for chest X-ray, brain MRI, and head CT, so adding a modality is a data change; all three are routed and tested, one is trained. On ChestMNIST that classifier reaches macro AUROC 0.729 and ranks better than chance on all 14 labels, at 1.6 to 6.8 times the precision a random ranker would get. Yet at the default 0.5 threshold it emits no positive prediction at all for 11 of them, and its excellent-looking Brier score of 0.045 sits beside the 0.047 earned by a predictor that ignores the image. The discrimination is real; the decisions are not. Under the class imbalance normal in radiology, aggregate metrics flatter models that do nothing, and should be reported against that floor.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

18 of 25 references.

References · 18

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2016Densely Connected Convolutional Networkscited by 6,720
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  7. 2017On Calibration of Modern Neural Networkscited by 4,960
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  9. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  10. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  11. 2018Sanity Checks for Saliency Mapscited by 1,156
  12. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
6 more
  1. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
  2. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 461
  3. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
  4. 2020Generating Radiology Reports via Memory-driven Transformercited by 368
  5. 2016Top-down Neural Attention by Excitation Backpropcited by 321
  6. 2019Clinically Accurate Chest X-Ray Report Generationcited by 139

Built on by

Not cited yet.