Large Language Models for Disease Diagnosis: A Scoping Review
Not on the map. Why?
Abstract (arXiv)
Automatic disease diagnosis has become increasingly valuable in clinical practice. The advent of large language models (LLMs) has catalyzed a paradigm shift in artificial intelligence, with growing evidence supporting the efficacy of LLMs in diagnostic tasks. Despite the increasing attention in this field, a holistic view is still lacking. Many critical aspects remain unclear, such as the diseases and clinical data to which LLMs have been applied, the LLM techniques employed, and the evaluation methods used. In this article, we perform a comprehensive review of LLM-based methods for disease diagnosis. Our review examines the existing literature across various dimensions, including disease types and associated clinical specialties, clinical data, LLM techniques, and evaluation methods. Additionally, we offer recommendations for applying and evaluating LLMs for diagnostic tasks. Furthermore, we assess the limitations of current research and discuss future directions. To our knowledge, this is the first comprehensive review for LLM-based disease diagnosis.
Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Aug 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 1; 2025: 34; 2026: 16.
51 papers.
Sort:
By area:
- 2025Dynamic and Generalizable Process Reward Modelingcited by 16
- 2025MMRAG: Multi-Mode Retrieval-Augmented Generation with Large Language Models for Biomedical In-Context Learningcited by 13
- 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMscited by 13
- 2025FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasetscited by 12
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
- 2024RAMIE: Retrieval-Augmented Multi-task Information Extraction with Large Language Models on Dietary Supplementscited by 11
- 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoningcited by 10
- 2025Structured Semantics from Unstructured Notes: Language Model Approaches to EHR-Based Decision Supportcited by 7
- 2025Tree-of-Reasoning: Towards Complex Medical Diagnosis via Multi-Agent Reasoning with Evidence Treecited by 7
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processingcited by 6
- 2025MACD: Multi-Agent Clinical Diagnosis with Self-Learned Knowledge for LLMcited by 6
- 2025Retrieval-augmented in-context learning for multimodal large language models in disease classificationcited by 5
38 more
- 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implicationscited by 5
- 2026Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoningcited by 5
- 2025AnchorAttention: Difference-Aware Sparse Attention with Stripe Granularitycited by 4
- 2025Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actionscited by 4
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challengescited by 3
- 2025Quantized Large Language Models in Biomedical Natural Language Processing: Evaluation and Recommendationcited by 3
- 2025Generalist Foundation Models Are Not Clinical Enough for Hospital Operationscited by 3
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Modelscited by 3
- 2025Rare Disease Differential Diagnosis with Large Language Models at Scale: From Abdominal Actinomycosis to Wilson's Diseasecited by 2
- 2025DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaborationcited by 2
- 2025Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Modelscited by 2
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?cited by 2
- 2025Explainable AI for Mental Health Emergency Returns: Integrating LLMs with Predictive Modelingcited by 1
- 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyondcited by 1
- 2025Refine Medical Diagnosis Using Generation Augmented Retrieval and Clinical Practice Guidelinescited by 1
- 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processescited by 1
- 2025DKG-LLM : A Framework for Medical Diagnosis and Personalized Treatment Recommendations via Dynamic Knowledge Graph and Large Language Model Integrationcited by 1
- 2025Data-Efficient Biomedical In-Context Learning: A Diversity-Enhanced Submodular Perspectivecited by 1
- 2025H-DDx: A Hierarchical Evaluation Framework for Differential Diagnosiscited by 1
- 2026Toward Federated Large Language Models in Medicine: A Parameter-Efficient Framework for Privacy-Preserving, Multi-Institutional Adaptationcited by 1
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatologycited by 1
- 2026ReportQA: QA-Based Radiology Report Evaluationcited by 1
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoningcited by 1
- 2025Continually Evolved Multimodal Foundation Models for Cancer Prognosiscited by 0
- 2025Fragments to Facts: Partial-Information Fragment Inference from LLMscited by 0
- 2025Early Diagnosis of Atrial Fibrillation Recurrence: A Large Tabular Model Approach with Structured and Unstructured Clinical Datacited by 0
- 2025A Multi-granularity Concept Sparse Activation and Hierarchical Knowledge Graph Fusion Framework for Rare Disease Diagnosiscited by 0
- 2025Generating Findings for Jaw Cysts in Dental Panoramic Radiographs Using a GPT-Based VLM: A Preliminary Study on Building a Two-Stage Self-Correction Loop with Structured Output (SLSO) Frameworkcited by 0
- 2025An Information-Theoretic Framework for Robust Large Language Model Editingcited by 0
- 2025ADMEDTAGGER: an annotation framework for distillation of expert knowledge for the Polish medical languagecited by 0
- 2026EpiScreen: Early Epilepsy Detection from Electronic Health Records with Large Language Modelscited by 0
- 2026Demystifying the Silence of Correctness Bugs in PyTorch Compilercited by 0
- 2026COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completioncited by 0
- 2026Data Attribution in Large Language Models via Bidirectional Gradient Optimizationcited by 0
- 2026A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trialcited by 0
- 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translationcited by 0
- 2026A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Supportcited by 0
50 most cited of 51 All 51 (JSON)
- 2026The average-farmer illusion in language-model simulations of agricultural decisions14 Sep 2026
- 2026A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support4 Sep 2026
- 2026Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning22 Aug 2026
- 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation28 Jul 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trial23 Jun 2026
- 2026ReportQA: QA-Based Radiology Report Evaluation13 Jun 2026
- 2026Data Attribution in Large Language Models via Bidirectional Gradient Optimization3 Jun 2026
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?27 May 2026
- 2026COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completion14 May 2026
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatology1 May 2026
- 2026Demystifying the Silence of Correctness Bugs in PyTorch Compiler9 Apr 2026
38 more
- 2026EpiScreen: Early Epilepsy Detection from Electronic Health Records with Large Language Models30 Mar 2026
- 2026Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoning29 Mar 2026
- 2026Toward Federated Large Language Models in Medicine: A Parameter-Efficient Framework for Privacy-Preserving, Multi-Institutional Adaptation29 Jan 2026
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models8 Jan 2026
- 2025ADMEDTAGGER: an annotation framework for distillation of expert knowledge for the Polish medical language27 Dec 2025
- 2025An Information-Theoretic Framework for Robust Large Language Model Editing18 Dec 2025
- 2025Generalist Foundation Models Are Not Clinical Enough for Hospital Operations17 Nov 2025
- 2025Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actions17 Nov 2025
- 2025Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Models15 Nov 2025
- 2025H-DDx: A Hierarchical Evaluation Framework for Differential Diagnosis4 Oct 2025
- 2025Generating Findings for Jaw Cysts in Dental Panoramic Radiographs Using a GPT-Based VLM: A Preliminary Study on Building a Two-Stage Self-Correction Loop with Structured Output (SLSO) Framework2 Oct 2025
- 2025MACD: Multi-Agent Clinical Diagnosis with Self-Learned Knowledge for LLM24 Sep 2025
- 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implications10 Sep 2025
- 2025Quantized Large Language Models in Biomedical Natural Language Processing: Evaluation and Recommendation4 Sep 2025
- 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning21 Aug 2025
- 2025Data-Efficient Biomedical In-Context Learning: A Diversity-Enhanced Submodular Perspective11 Aug 2025
- 2025DKG-LLM : A Framework for Medical Diagnosis and Personalized Treatment Recommendations via Dynamic Knowledge Graph and Large Language Model Integration8 Aug 2025
- 2025Tree-of-Reasoning: Towards Complex Medical Diagnosis via Multi-Agent Reasoning with Evidence Tree5 Aug 2025
- 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes25 Jul 2025
- 2025Dynamic and Generalizable Process Reward Modeling23 Jul 2025
- 2025A Multi-granularity Concept Sparse Activation and Hierarchical Knowledge Graph Fusion Framework for Rare Disease Diagnosis11 Jul 2025
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMs3 Jul 2025
- 2025Refine Medical Diagnosis Using Generation Augmented Retrieval and Clinical Practice Guidelines22 Jun 2025
- 2025Structured Semantics from Unstructured Notes: Language Model Approaches to EHR-Based Decision Support1 Jun 2025
- 2025AnchorAttention: Difference-Aware Sparse Attention with Stripe Granularity29 May 2025
- 2025FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets26 May 2025
- 2025DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration24 May 2025
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challenges21 May 2025
- 2025Early Diagnosis of Atrial Fibrillation Recurrence: A Large Tabular Model Approach with Structured and Unstructured Clinical Data20 May 2025
- 2025Fragments to Facts: Partial-Information Fragment Inference from LLMs20 May 2025
- 2025Retrieval-augmented in-context learning for multimodal large language models in disease classification4 May 2025
- 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs20 Apr 2025
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processing1 Mar 2025
- 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyond28 Feb 2025
- 2025MMRAG: Multi-Mode Retrieval-Augmented Generation with Large Language Models for Biomedical In-Context Learning21 Feb 2025
- 2025Rare Disease Differential Diagnosis with Large Language Models at Scale: From Abdominal Actinomycosis to Wilson's Disease20 Feb 2025
- 2025Continually Evolved Multimodal Foundation Models for Cancer Prognosis30 Jan 2025
- 2025Explainable AI for Mental Health Emergency Returns: Integrating LLMs with Predictive Modeling21 Jan 2025
50 newest of 51 All 51 (JSON)
- 2025Dynamic and Generalizable Process Reward Modelingcited by 16
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
- 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoningcited by 10
- 2025Tree-of-Reasoning: Towards Complex Medical Diagnosis via Multi-Agent Reasoning with Evidence Treecited by 7
- 2026Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoningcited by 5
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Modelscited by 3
- 2025DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaborationcited by 2
- 2025Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Modelscited by 2
- 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processescited by 1
- 2026Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoningcited by 1
- 2026COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completioncited by 0
- 2026A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trialcited by 0
- 2026Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning22 Aug 2026
- 2026A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trial23 Jun 2026
- 2026COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completion14 May 2026
- 2026Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoning29 Mar 2026
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models8 Jan 2026
- 2025Adaptive Diagnostic Reasoning Framework for Pathology with Multimodal Large Language Models15 Nov 2025
- 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning21 Aug 2025
- 2025Tree-of-Reasoning: Towards Complex Medical Diagnosis via Multi-Agent Reasoning with Evidence Tree5 Aug 2025
- 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes25 Jul 2025
- 2025Dynamic and Generalizable Process Reward Modeling23 Jul 2025
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMs3 Jul 2025
- 2025DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration24 May 2025
- 2025MACD: Multi-Agent Clinical Diagnosis with Self-Learned Knowledge for LLMcited by 6
- 2025Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actionscited by 4
- 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translationcited by 0
- 2026A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Supportcited by 0
- 2026The average-farmer illusion in language-model simulations of agricultural decisionscited by 0
- 2026The average-farmer illusion in language-model simulations of agricultural decisions14 Sep 2026
- 2026A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support4 Sep 2026
- 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation28 Jul 2026
- 2025Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actions17 Nov 2025
- 2025MACD: Multi-Agent Clinical Diagnosis with Self-Learned Knowledge for LLM24 Sep 2025
- 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMscited by 13
- 2025FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasetscited by 12
- 2025Structured Semantics from Unstructured Notes: Language Model Approaches to EHR-Based Decision Supportcited by 7
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processingcited by 6
- 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implicationscited by 5
- 2025AnchorAttention: Difference-Aware Sparse Attention with Stripe Granularitycited by 4
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challengescited by 3
- 2025Quantized Large Language Models in Biomedical Natural Language Processing: Evaluation and Recommendationcited by 3
- 2025Generalist Foundation Models Are Not Clinical Enough for Hospital Operationscited by 3
- 2025Rare Disease Differential Diagnosis with Large Language Models at Scale: From Abdominal Actinomycosis to Wilson's Diseasecited by 2
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?cited by 2
- 2025Explainable AI for Mental Health Emergency Returns: Integrating LLMs with Predictive Modelingcited by 1
12 most cited of 30 All 30 (JSON)
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026ReportQA: QA-Based Radiology Report Evaluation13 Jun 2026
- 2026Data Attribution in Large Language Models via Bidirectional Gradient Optimization3 Jun 2026
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?27 May 2026
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatology1 May 2026
- 2026Demystifying the Silence of Correctness Bugs in PyTorch Compiler9 Apr 2026
- 2026EpiScreen: Early Epilepsy Detection from Electronic Health Records with Large Language Models30 Mar 2026
- 2026Toward Federated Large Language Models in Medicine: A Parameter-Efficient Framework for Privacy-Preserving, Multi-Institutional Adaptation29 Jan 2026
- 2025ADMEDTAGGER: an annotation framework for distillation of expert knowledge for the Polish medical language27 Dec 2025
- 2025An Information-Theoretic Framework for Robust Large Language Model Editing18 Dec 2025
- 2025Generalist Foundation Models Are Not Clinical Enough for Hospital Operations17 Nov 2025
- 2025H-DDx: A Hierarchical Evaluation Framework for Differential Diagnosis4 Oct 2025
12 newest of 30 All 30 (JSON)