EHRNavigator: A Multi-Agent System for Patient-Level Clinical Question Answering over Heterogeneous Electronic Health Records
Not on the map. Why?
Abstract (arXiv)
Clinical decision-making increasingly relies on timely and context-aware access to patient information within Electronic Health Records (EHRs), yet most existing natural language question-answering (QA) systems are evaluated solely on benchmark datasets, limiting their practical relevance. To overcome this limitation, we introduce EHRNavigator, a multi-agent framework that harnesses AI agents to perform patient-level question answering across heterogeneous and multimodal EHR data. We assessed its performance using both public benchmark and institutional datasets under realistic hospital conditions characterized by diverse schemas, temporal reasoning demands, and multimodal evidence integration. Through quantitative evaluation and clinician-validated chart review, EHRNavigator demonstrated strong generalization, achieving 86% accuracy on real-world cases while maintaining clinically acceptable response times. Overall, these findings confirm that EHRNavigator effectively bridges the gap between benchmark evaluation and clinical deployment, offering a robust, adaptive, and efficient solution for real-world EHR question answering.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
29 of 46 references.
References · 29
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2024GPT-4o System Cardcited by 4,467
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
- 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 76
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
17 more
- 2023EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Imagescited by 53
- 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 42
- 2024EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge Summariescited by 33
- 2020Knowledge Graph-based Question Answering with Electronic Health Recordscited by 19
- 2022DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queriescited by 17
- 2024BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Modelscited by 15
- 2025Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Predictioncited by 11
- 2021Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecturecited by 9
- 2024Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Recordscited by 9
- 2024Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health recordscited by 8
- 2023Question Answering for Electronic Health Records: A Scoping Review of datasets and modelscited by 7
- 2024EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Recordscited by 5
- 2024Evaluating Search Engines and Large Language Models for Answering Health Questionscited by 5
- 2024Dynamic Q&A of Clinical Documents with Large Language Modelscited by 4
- 2025MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generationcited by 4
- 2019A semi-autonomous approach to connecting proprietary EHR standards to FHIRcited by 2
- 2021Self-supervised Answer Retrieval on Clinical Notescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FHIR-AgentBench: Benchmarking LLM Agents for Realistic Interoperable EHR Question Answering
- 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
- 2024LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models
- 2025AutoMedic: An Automated Evaluation Framework for Clinical Conversational Agents with Medical Dataset Grounding
- 2025From Conversation to Query Execution: Benchmarking User and Tool Interactions for EHR Database Agents
- 2024Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education
- 2026Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering
- 2026EHR-RobustGym: Benchmarking and Training Agents for Robust Clinical Reasoning