The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports
Not on the map. Why?
Abstract (arXiv)
AI-assisted clinical documentation tools increasingly summarize, standardize, and reformat radiology reports using large language models (LLMs). We present a controlled measurement of the resulting information degradation. Using 450 chest X-ray reports from the Indiana University dataset, we generate synthetic versions via three realistic LLM rewriting tasks: EHR summarization, standardized rewriting, and teaching case preparation. We measure entity erosion (via medical NER), hedging collapse (loss of clinical uncertainty language), and cross-modal alignment degradation (via BiomedCLIP image-text similarity). Our central finding is a dissociation between information loss and cross-modal fidelity. EHR summarization is the most destructive at the content level, eroding 51.4% of clinical entities and 43.7% of hedging language, yet it preserves image-text alignment almost entirely (a 2.5% drop). The two tasks meant to produce cleaner training data, standardized rewriting and teaching case preparation, do the reverse: they preserve more entities (26.8% and 29.3% eroded) but cause 14.9-16.5% alignment drops, six to seven times those of EHR summarization. We term this the slop paradox: rewriting that makes clinical text look cleaner for multimodal training is precisely what pulls it away from the image. Contrary to our pre-specified hypothesis, rare pathologies were not preferentially degraded: across nine rare-versus-common comparisons, no difference survived multiple-comparison correction, and nominal differences ran in the opposite direction (common > rare), so contamination is invisible to condition-specific monitoring. The dominant determinant of degradation is the type of AI rewriting task, not the clinical content. These findings bear on multimodal medical AI dataset construction and the governance of AI-assisted clinical documentation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 20 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
8 of 20 references.
References · 8
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
- 2026Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025cited by 15
- 2024Synthetic Data in Radiological Imaging: Current State and Future Outlookcited by 7
- 2025Modeling Clinical Uncertainty in Radiology Reports: from Explicit Uncertainty Markers to Implicit Reasoning Pathwayscited by 4
- 2026Context Collapse: In-Context Learning and Model Collapsecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Corpus Characterization and Inverse Constitutional Fine-Tuning for Style-Aware Radiology Reports
- 2026templar: agentic induction and evolution of standardized radiology reporting templates from large-scale clinical corpora
- 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation
- 2026Auditing Medical Vision-Language Models on Chest Radiographs: Estimating Reference Agreement Across Institutions
- 2026Improving Health Literacy through Lay Summarization of Radiological Reports: An Evaluation of BioNER and Retrieval-Augmented Generation
- 2025Agent-Based Uncertainty Awareness Improves Automated Radiology Report Labeling with an Open-Source Large Language Model
- 2026Intelligent Documentation in Medical Education: Can AI Replace Manual Case Logging?
- 2026Graph-Supervised Hierarchical Clinical Alignment for Radiology Report Generation with Large Language Models