Leveraging Imperfection with MEDLEY A Multi-Model Approach Harnessing Bias in Medical AI
Not on the map. Why?
Abstract (arXiv)
Bias in medical artificial intelligence is conventionally viewed as a defect requiring elimination. However, human reasoning inherently incorporates biases shaped by education, culture, and experience, suggesting their presence may be inevitable and potentially valuable. We propose MEDLEY (Medical Ensemble Diagnostic system with Leveraged diversitY), a conceptual framework that orchestrates multiple AI models while preserving their diverse outputs rather than collapsing them into a consensus. Unlike traditional approaches that suppress disagreement, MEDLEY documents model-specific biases as potential strengths and treats hallucinations as provisional hypotheses for clinician verification. A proof-of-concept demonstrator was developed using over 30 large language models, creating a minimum viable product that preserved both consensus and minority views in synthetic cases, making diagnostic uncertainty and latent biases transparent for clinical oversight. While not yet a validated clinical tool, the demonstration illustrates how structured diversity can enhance medical reasoning under clinician supervision. By reframing AI imperfection as a resource, MEDLEY offers a paradigm shift that opens new regulatory, ethical, and innovation pathways for developing trustworthy medical AI systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 29 Aug 2025.
Builds on
15 of 53 references.
References · 15
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 511
- 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 240
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 193
- 2020Ethical Machine Learning in Health Carecited by 113
- 2025Sequential Diagnosis with Language Modelscited by 60
- 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanationscited by 45
- 2019"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learningcited by 39
- 2024A Survey on Self-play Methods in Reinforcement Learningcited by 26
- 2023Why is the winner the best?cited by 21
3 more
- 2023Manipulation Risks in Explainable AI: The Implications of the Disagreement Problemcited by 7
- 2024Enhancing Radiological Diagnosis: A Collaborative Approach Integrating AI and Human Expertise for Visual Miss Correctioncited by 2
- 2025Addressing Intersectionality, Explainability, and Ethics in AI-Driven Diagnostics: A Rebuttal and Call for Transdiciplinary Actioncited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Data Poisoning Vulnerabilities Across Healthcare AI Architectures: A Security Threat Analysiscited by 3
- 2026AEGIS: An Operational Infrastructure for Post-Market Governance of Adaptive Medical AI Under US and EU Regulationscited by 0
- 2026From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentationcited by 0
- 2026MEDLEY-BENCH: Benchmarking Behavioural Metacognition and Belief Revision Under Social Pressure in Large Language Modelscited by 0
- 2026MEDLEY-BENCH: Benchmarking Behavioural Metacognition and Belief Revision Under Social Pressure in Large Language Models17 Apr 2026
- 2026AEGIS: An Operational Infrastructure for Post-Market Governance of Adaptive Medical AI Under US and EU Regulations20 Mar 2026
- 2026From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentation2 Mar 2026
- 2025Data Poisoning Vulnerabilities Across Healthcare AI Architectures: A Security Threat Analysis14 Nov 2025