mlsanityData to 14 Oct 2026

Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded Reasoning

arXiv 2502.07143 ↗First posted 11 Feb 2025cs.CLcited by 19

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

The severe shortage of medical doctors limits access to timely and reliable healthcare, leaving millions underserved. Large language models (LLMs) offer a potential solution but struggle in real-world clinical interactions. Many LLMs are not grounded in authoritative medical guidelines and fail to transparently manage diagnostic uncertainty. Their language is often rigid and mechanical, lacking the human-like qualities essential for patient trust. To address these challenges, we propose Ask Patients with Patience (APP), a multi-turn LLM-based medical assistant designed for grounded reasoning, transparent diagnoses, and human-centric interaction. APP enhances communication by eliciting user symptoms through empathetic dialogue, significantly improving accessibility and user engagement. It also incorporates Bayesian active learning to support transparent and adaptive diagnoses. The framework is built on verified medical guidelines, ensuring clinically grounded and evidence-based reasoning. To evaluate its performance, we develop a new benchmark that simulates realistic medical conversations using patient agents driven by profiles extracted from real-world consultation cases. We compare APP against SOTA one-shot and multi-turn LLM baselines. The results show that APP improves diagnostic accuracy, reduces uncertainty, and enhances user experience. By integrating medical expertise with transparent, human-like interaction, APP bridges the gap between AI-driven medical assistance and real-world clinical practice.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 14 of its 39 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

14 of 39 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  4. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
  5. 2024Capabilities of Gemini Models in Medicinecited by 237
  6. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
  7. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  8. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
  9. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
  10. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 90
  11. 2023BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPTcited by 65
  12. 2024MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answeringcited by 26
2 more
  1. 2024BiMediX: Bilingual Medical Mixture of Experts LLMcited by 21
  2. 2023KNSE: A Knowledge-aware Natural Language Inference Framework for Dialogue Symptom Status Recognitioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 10.

19 papers.

Sort:

By area:

  1. 2025Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluationcited by 30
  2. 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmarkcited by 16
  3. 2025ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMscited by 13
  4. 2025InfiMed-ORBIT: Aligning LLMs on Open-Ended Complex Tasks via Rubric-Based Incremental Trainingcited by 12
  5. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applicationscited by 10
  6. 2025CaRT: Teaching LLM Agents to Know When They Know Enoughcited by 7
  7. 2025Reasoning Is Not All You Need: Examining LLMs for Multi-Turn Mental Health Conversationscited by 6
  8. 2026Evo-MedAgent: Beyond One-Shot Diagnosis with Agents That Remember, Reflect, and Improvecited by 6
  9. 2026MedOpenClaw and MedFlowBench: Auditing Medical Agents in Full-Study Workflowscited by 5
  10. 2026Strong Reasoning Isn't Enough: Evaluating Evidence Elicitation in Interactive Diagnosiscited by 3
  11. 2025AI Standardized Patient Improves Human Conversations in Advanced Cancer Carecited by 2
  12. 2026Active Evidence-Seeking and Diagnostic Reasoning in Large Language Models for Clinical Decision Supportcited by 1
7 more
  1. 2026DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMscited by 1
  2. 2025GraphMed-LT: Patient-Specific Graph Memory with Latent Clinical Thought Refinement for Multi-Turn Medical Conversationscited by 0
  3. 2026ChatHealthAI: Aligning Electronic Health Record Representations with Large Language Models for Grounded Clinical Reasoningcited by 0
  4. 2026Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Modelscited by 0
  5. 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-makingcited by 0
  6. 2026Ask or Answer: A Decision Framework for Multi-Turn Health Misinformation Interventioncited by 0
  7. 2026MedRoundsQA: A Persona and Difficulty Aware Evaluation for Multi-Turn Medical Consultationscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025AutoMedic: An Automated Evaluation Framework for Clinical Conversational Agents with Medical Dataset Grounding
  2. 2026MedDialogRubrics: A Comprehensive Benchmark and Evaluation Framework for Multi-turn Medical Consultations in Large Language Models
  3. 2026MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observability
  4. 2025Advancing Conversational Diagnostic AI with Multimodal Reasoning
  5. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning
  6. 2026Dialogue to Question Generation for Evidence-based Medical Guideline Agent Development
  7. 2026A prospective clinical feasibility study of a conversational diagnostic AI in an ambulatory primary care clinic
  8. 2025Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations