AI-generated data contamination erodes pathological variability and diagnostic reliability
Not on the map. Why?
Abstract (arXiv)
Generative artificial intelligence (AI) is rapidly populating medical records with synthetic content, creating a feedback loop where future models are increasingly at risk of training on uncurated AI-generated data. However, the clinical consequences of this AI-generated data contamination remain unexplored. Here, we show that in the absence of mandatory human verification, this self-referential cycle drives a rapid erosion of pathological variability and diagnostic reliability. By analysing more than 800,000 synthetic data points across clinical text generation, vision-language reporting, and medical image synthesis, we find that models progressively converge toward generic phenotypes regardless of the model architecture. Specifically, rare but critical findings, including pneumothorax and effusions, vanish from the synthetic content generated by AI models, while demographic representations skew heavily toward middle-aged male phenotypes. Crucially, this degradation is masked by false diagnostic confidence; models continue to issue reassuring reports while failing to detect life-threatening pathology, with false reassurance rates tripling to 40%. Blinded physician evaluation confirms that this decoupling of confidence and accuracy renders AI-generated documentation clinically useless after just two generations. We systematically evaluate three mitigation strategies, finding that while synthetic volume scaling fails to prevent collapse, mixing real data with quality-aware filtering effectively preserves diversity. Ultimately, our results suggest that without policy-mandated human oversight, the deployment of generative AI threatens to degrade the very healthcare data ecosystems it relies upon.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
7 of 25 references.
References · 7
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
- 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
Built on by
Citing papers per year: 2026: 1.
1 paper.