The Ethics of ChatGPT in Medicine and Healthcare: A Systematic Review on Large Language Models (LLMs)
Not on the map. Why?
Abstract (arXiv)
With the introduction of ChatGPT, Large Language Models (LLMs) have received enormous attention in healthcare. Despite their potential benefits, researchers have underscored various ethical implications. While individual instances have drawn much attention, the debate lacks a systematic overview of practical applications currently researched and ethical issues connected to them. Against this background, this work aims to map the ethical landscape surrounding the current stage of deployment of LLMs in medicine and healthcare. Electronic databases and preprint servers were queried using a comprehensive search strategy. Studies were screened and extracted following a modified rapid review approach. Methodological quality was assessed using a hybrid approach. For 53 records, a meta-aggregative synthesis was performed. Four fields of applications emerged and testify to a vivid exploration phase. Advantages of using LLMs are attributed to their capacity in data analysis, personalized information provisioning, support in decision-making, mitigating information loss and enhancing information accessibility. However, we also identifies recurrent ethical concerns connected to fairness, bias, non-maleficence, transparency, and privacy. A distinctive concern is the tendency to produce harmful misinformation or convincingly but inaccurate content. A recurrent plea for ethical guidance and human oversight is evident. Given the variety of use cases, it is suggested that the ethical guidance debate be reframed to focus on defining what constitutes acceptable human oversight across the spectrum of applications. This involves considering diverse settings, varying potentials for harm, and different acceptable thresholds for performance and certainty in healthcare. In addition, a critical inquiry is necessary to determine the extent to which the current experimental use of LLMs is necessary and justified.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Mar 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 9; 2025: 29; 2026: 7.
45 papers.
Sort:
By area:
- 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
- 2025Fully Autonomous AI Agents Should Not be Developedcited by 45
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 26
- 2024MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applicationscited by 25
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Modelscited by 22
- 2024The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic reviewcited by 21
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 20
- 2024The Open Source Advantage in Large Language Models (LLMs)cited by 18
- 2025Attack and defense techniques in large language models: A survey and new perspectivescited by 14
- 2024Enhancing LLMs for Impression Generation in Radiology Reports through a Multi-Agent Systemcited by 11
- 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcarecited by 10
- 2025Comparative Analysis Based on DeepSeek, ChatGPT, and Google Gemini: Features, Techniques, Performance, Future Prospectscited by 9
33 more
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verificationcited by 9
- 2025TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Lawcited by 8
- 2025Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Managementcited by 7
- 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modellingcited by 7
- 2025The Reliability of LLMs for Medical Diagnosis: An Examination of Consistency, Manipulation, and Contextual Awarenesscited by 5
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generationcited by 4
- 2024Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Datacited by 4
- 2024Conversational Medical AI: Ready for Practicecited by 4
- 2025Eeyore: Realistic Depression Simulation via Supervised and Preference Optimizationcited by 3
- 2025From Metaphor to Mechanism: How LLMs Decode Traditional Chinese Medicine Symbolic Language for Modern Clinical Relevancecited by 3
- 2025Self-Reported Confidence of Large Language Models in Gastroenterology: Analysis of Commercial, Open-Source, and Quantized Modelscited by 3
- 2025Privacy Challenges and Solutions in Retrieval-Augmented Generation-Enhanced LLMs for Healthcare Chatbots: A Review of Applications, Risks, and Future Directionscited by 3
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellnesscited by 3
- 2026This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMscited by 3
- 2025Echoes of Automation: The Increasing Use of LLMs in Newsmakingcited by 2
- 2025Can LLMs Help Allocate Public Health Resources? A Case Study on Childhood Lead Testingcited by 2
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Modelscited by 2
- 2025Development of Application-Specific Large Language Models to Facilitate Research Ethics Reviewcited by 1
- 2025OphthBench: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Ophthalmologycited by 1
- 2025Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routingcited by 1
- 2025Capability Localization: Capabilities Can be Localized rather than Individual Knowledgecited by 1
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewingcited by 1
- 2025Bias Detection in Emergency Psychiatry: Linking Negative Language to Diagnostic Disparitiescited by 1
- 2025Dr. Bias: Social Disparities in AI-Powered Medical Guidancecited by 1
- 2026EMAD: Evidence-Centric Grounded Multimodal Diagnosis for Alzheimer's Diseasecited by 1
- 2025The Dual-use Dilemma in LLMs: Do Empowering Ethical Capacities Make a Degraded Utility?cited by 0
- 2025Multi-modal Integration Analysis of Alzheimer's Disease Using Large Language Models and Knowledge Graphscited by 0
- 2025MDD-Thinker: Towards Large Reasoning Models for Major Depressive Disorder Diagnosiscited by 0
- 2025Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignmentcited by 0
- 2026medR: Reward Engineering for Clinical Offline Reinforcement Learning via Tri-Drive Potential Functionscited by 0
- 2026Generative-AI and the transformation of workforce. A job postings-driven analysiscited by 0
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learningcited by 0
- 2026Toward Vibe Medicine: A Self-Evolving Multi-Agent Framework for Clinical Decision Supportcited by 0
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models18 May 2026
- 2026Generative-AI and the transformation of workforce. A job postings-driven analysis7 Apr 2026
- 2026Toward Vibe Medicine: A Self-Evolving Multi-Agent Framework for Clinical Decision Support1 Apr 2026
- 2026This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs16 Mar 2026
- 2026EMAD: Evidence-Centric Grounded Multimodal Diagnosis for Alzheimer's Disease22 Feb 2026
- 2026medR: Reward Engineering for Clinical Offline Reinforcement Learning via Tri-Drive Potential Functions3 Feb 2026
- 2025Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignment30 Dec 2025
- 2025Can LLMs Help Allocate Public Health Resources? A Case Study on Childhood Lead Testing23 Nov 2025
- 2025Privacy Challenges and Solutions in Retrieval-Augmented Generation-Enhanced LLMs for Healthcare Chatbots: A Review of Applications, Risks, and Future Directions14 Nov 2025
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verification12 Nov 2025
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness23 Oct 2025
33 more
- 2025Dr. Bias: Social Disparities in AI-Powered Medical Guidance10 Oct 2025
- 2025MDD-Thinker: Towards Large Reasoning Models for Major Depressive Disorder Diagnosis29 Sep 2025
- 2025Bias Detection in Emergency Psychiatry: Linking Negative Language to Diagnostic Disparities2 Sep 2025
- 2025Echoes of Automation: The Increasing Use of LLMs in Newsmaking8 Aug 2025
- 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modelling7 Aug 2025
- 2025TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Law22 Jul 2025
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models10 Jul 2025
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs6 Jun 2025
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewing23 May 2025
- 2025Multi-modal Integration Analysis of Alzheimer's Disease Using Large Language Models and Knowledge Graphs21 May 2025
- 2025Attack and defense techniques in large language models: A survey and new perspectives2 May 2025
- 2025Self-Reported Confidence of Large Language Models in Gastroenterology: Analysis of Commercial, Open-Source, and Quantized Models24 Mar 2025
- 2025From Metaphor to Mechanism: How LLMs Decode Traditional Chinese Medicine Symbolic Language for Modern Clinical Relevance4 Mar 2025
- 2025The Reliability of LLMs for Medical Diagnosis: An Examination of Consistency, Manipulation, and Contextual Awareness2 Mar 2025
- 2025Capability Localization: Capabilities Can be Localized rather than Individual Knowledge28 Feb 2025
- 2025Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routing26 Feb 2025
- 2025Comparative Analysis Based on DeepSeek, ChatGPT, and Google Gemini: Features, Techniques, Performance, Future Prospects25 Feb 2025
- 2025Eeyore: Realistic Depression Simulation via Supervised and Preference Optimization21 Feb 2025
- 2025Fully Autonomous AI Agents Should Not be Developed4 Feb 2025
- 2025OphthBench: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Ophthalmology3 Feb 2025
- 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcare27 Jan 2025
- 2025Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management22 Jan 2025
- 2025The Dual-use Dilemma in LLMs: Do Empowering Ethical Capacities Make a Degraded Utility?20 Jan 2025
- 2025Development of Application-Specific Large Language Models to Facilitate Research Ethics Review18 Jan 2025
- 2024The Open Source Advantage in Large Language Models (LLMs)16 Dec 2024
- 2024Enhancing LLMs for Impression Generation in Radiology Reports through a Multi-Agent System6 Dec 2024
- 2024Conversational Medical AI: Ready for Practice19 Nov 2024
- 2024Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Data25 Sep 2024
- 2024MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applications11 Sep 2024
- 2024LLMs Will Always Hallucinate, and We Need to Live With This9 Sep 2024
- 2024The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic review6 Sep 2024
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generation27 Aug 2024
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Modelscited by 22
- 2025Comparative Analysis Based on DeepSeek, ChatGPT, and Google Gemini: Features, Techniques, Performance, Future Prospectscited by 9
- 2025The Dual-use Dilemma in LLMs: Do Empowering Ethical Capacities Make a Degraded Utility?cited by 0
- 2025MDD-Thinker: Towards Large Reasoning Models for Major Depressive Disorder Diagnosiscited by 0
- 2025MDD-Thinker: Towards Large Reasoning Models for Major Depressive Disorder Diagnosis29 Sep 2025
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models10 Jul 2025
- 2025Comparative Analysis Based on DeepSeek, ChatGPT, and Google Gemini: Features, Techniques, Performance, Future Prospects25 Feb 2025
- 2025The Dual-use Dilemma in LLMs: Do Empowering Ethical Capacities Make a Degraded Utility?20 Jan 2025
- 2024MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applicationscited by 25
- 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcarecited by 10
- 2025TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Lawcited by 8
- 2025TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Law22 Jul 2025
- 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcare27 Jan 2025
- 2024MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applications11 Sep 2024
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 20
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
- 2025Fully Autonomous AI Agents Should Not be Developedcited by 45
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 26
- 2024The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic reviewcited by 21
- 2024The Open Source Advantage in Large Language Models (LLMs)cited by 18
- 2025Attack and defense techniques in large language models: A survey and new perspectivescited by 14
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verificationcited by 9
- 2025Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Managementcited by 7
- 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modellingcited by 7
- 2025The Reliability of LLMs for Medical Diagnosis: An Examination of Consistency, Manipulation, and Contextual Awarenesscited by 5
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generationcited by 4
- 2024Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Datacited by 4
12 most cited of 30 All 30 (JSON)
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models18 May 2026
- 2026Generative-AI and the transformation of workforce. A job postings-driven analysis7 Apr 2026
- 2026This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs16 Mar 2026
- 2026EMAD: Evidence-Centric Grounded Multimodal Diagnosis for Alzheimer's Disease22 Feb 2026
- 2025Can LLMs Help Allocate Public Health Resources? A Case Study on Childhood Lead Testing23 Nov 2025
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verification12 Nov 2025
- 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellness23 Oct 2025
- 2025Dr. Bias: Social Disparities in AI-Powered Medical Guidance10 Oct 2025
- 2025Bias Detection in Emergency Psychiatry: Linking Negative Language to Diagnostic Disparities2 Sep 2025
- 2025Echoes of Automation: The Increasing Use of LLMs in Newsmaking8 Aug 2025
- 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modelling7 Aug 2025
12 newest of 30 All 30 (JSON)