mlsanityData to 7 Oct 2026

Almanac Copilot: Towards Autonomous Electronic Health Record Navigation

arXiv 2405.07896 ↗First posted 30 Apr 2024cs.AI cs.HC cs.IRcited by 9

Not on the map. Why?

Abstract (arXiv)

Clinicians spend large amounts of time on clinical documentation, and inefficiencies impact quality of care and increase clinician burnout. Despite the promise of electronic medical records (EMR), the transition from paper-based records has been negatively associated with clinician wellness, in part due to poor user experience, increased burden of documentation, and alert fatigue. In this study, we present Almanac Copilot, an autonomous agent capable of assisting clinicians with EMR-specific tasks such as information retrieval and order placement. On EHR-QA, a synthetic evaluation dataset of 300 common EHR queries based on real patient data, Almanac Copilot obtains a successful task completion rate of 74% (n = 221 tasks) with a mean score of 2.45 over 3 (95% CI:2.34-2.56). By automating routine tasks and streamlining the documentation process, our findings highlight the significant potential of autonomous agents to mitigate the cognitive load imposed on clinicians by current EMR systems.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 58 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

28 of 58 references.

References · 28

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  6. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  7. 2019Root Mean Square Layer Normalizationcited by 1,425
  8. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  9. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  10. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 700
  11. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  12. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
16 more
  1. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  2. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
  3. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  4. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  5. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  6. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
  7. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 122
  8. 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 76
  9. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
  10. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  11. 2022PLM-ICD: Automatic ICD Coding with Pretrained Language Modelscited by 49
  12. 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 42
  13. 2024LLMs in the Imaginarium: Tool Learning through Simulated Trial and Errorcited by 19
  14. 2023Customizing General-Purpose Foundation Models for Medical Report Generationcited by 9
  15. 2024LLM on FHIR -- Demystifying Health Recordscited by 9
  16. 2024ReALM: Reference Resolution As Language Modelingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 2.

9 papers.

  1. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
  2. 2024Medchain: Bridging the Gap Between LLM Agents and Clinical Practice with Interactive Sequencecited by 15
  3. 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discoverycited by 10
  4. 2025A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoningcited by 3
  5. 2024Generative AI in Medicinecited by 1
  6. 2025EEG-MedRAG: Enhancing EEG-based Clinical Decision-Making via Hierarchical Hypergraph Retrieval-Augmented Generationcited by 1
  7. 2026Empowering Locally Deployable Medical Agent via State Enhanced Logical Skills for FHIR-based Clinical Taskscited by 1
  8. 2025RPRO: Ranked Preference Reinforcement Optimization for Enhancing Medical QA and Diagnostic Reasoningcited by 0
  9. 2025Evaluating Medical LLMs by Levels of Autonomy: A Survey Moving from Benchmarks to Applicationscited by 0