M3: Conversational LLMs Simplify Secure Clinical Data Access, Understanding, and Analysis
Not on the map. Why?
Abstract (arXiv)
Large-scale clinical databases offer opportunities for medical research, but their complexity creates barriers to effective use. The Medical Information Mart for Intensive Care (MIMIC-IV), one of the world's largest open-source electronic health record databases, traditionally requires both SQL proficiency and clinical domain expertise. We introduce M3, a system that enables natural language querying of MIMIC-IV data through the Model Context Protocol. With a single command, M3 retrieves MIMIC-IV from PhysioNet, launches a local SQLite instance or connects to hosted BigQuery, and allows researchers to pose clinical questions in plain English. We evaluated M3 using samples from the EHRSQL 2024 benchmark with two language models. On one hundred answerable questions, the proprietary Claude Sonnet 4 achieved 94% accuracy and the open-weights gpt-oss-20B (deployable locally on consumer hardware) achieved 93%; on a matched sample of one hundred unanswerable questions, where correct behavior is to abstain rather than produce SQL, gpt-oss-20B correctly abstained on 69%. Both models translate natural language into SQL, execute queries against MIMIC-IV, and return structured results alongside the underlying query for verification. Error analysis revealed that most failures stemmed from complex temporal reasoning or ambiguous question phrasing rather than fundamental architectural limitations. The comparable performance of a smaller open-weights model demonstrates that privacy-preserving local deployment is viable for sensitive clinical data analysis. M3 lowers technical barriers to critical care data analysis and is designed with security measures including OAuth2 authentication, query validation, and audit logging.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
13 of 41 references.
References · 13
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 390
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
- 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 77
- 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 45
- 2023Evaluating Cross-Domain Text-to-SQL Models and Benchmarkscited by 32
- 2024TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoringcited by 17
- 2024Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Recordscited by 11
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
1 more
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Automating Clinical Information Retrieval from Finnish Electronic Health Records Using Large Language Models
- 2026Future Querying: Can LLMs Serve as Implicit Medical World Models?
- 2025MediEval: A Unified Medical Benchmark for Patient-Contextual and Knowledge-Grounded Reasoning in LLMs
- 2025Building a Human-Verified Clinical Reasoning Dataset via a Human LLM Hybrid Pipeline for Trustworthy Medical AI
- 2026Harnessing Large Language Models for Precision Querying and Retrieval-Augmented Knowledge Extraction in Clinical Data Science
- 2024Dynamic Q&A of Clinical Documents with Large Language Models
- 2025Med-R2: Crafting Trustworthy LLM Physicians via Retrieval and Reasoning of Evidence-Based Medicine
- 2024HealthQ: Unveiling Questioning Capabilities of LLM Chains in Healthcare Conversations