# Conceptualizing Machine Learning for Dynamic Information Retrieval of Electronic Health Record Notes

arXiv: https://arxiv.org/abs/2308.08494 · HTML: https://mlsanity.com/paper/2308.08494/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 33 references that are in the map.
- First posted on arXiv 9 Aug 2023.

## Builds on (most cited first, 11 of 11)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Publicly Available Clinical BERT Embeddings](https://mlsanity.com/paper/1904.03323/) (2019)
- [Large Language Models are Few-Shot Clinical Information Extractors](https://mlsanity.com/paper/2205.12689/) (2022)
- [Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review](https://mlsanity.com/paper/2107.02975/) (2021)
- [Ontology-Aware Clinical Abstractive Summarization](https://mlsanity.com/paper/1905.05818/) (2019)
- [Beyond Summarization: Designing AI Support for Real-World Expository Writing Tasks](https://mlsanity.com/paper/2304.02623/) (2023)
- [Extractive Summarization of EHR Discharge Notes](https://mlsanity.com/paper/1810.12085/) (2018)
- [MedKnowts: Unified Documentation and Information Retrieval for Electronic Health Records](https://mlsanity.com/paper/2109.11451/) (2021)
- [Embedding Electronic Health Records for Clinical Information Retrieval](https://mlsanity.com/paper/1811.05402/) (2018)
- [Fast, Structured Clinical Documentation via Contextual Autocomplete](https://mlsanity.com/paper/2007.15153/) (2020)

## Built on by (most cited first, 4 of 4)

- [General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite History](https://mlsanity.com/paper/2310.20204/) (2023)
- [Retrieving Evidence from EHRs with LLMs: Possibilities and Challenges](https://mlsanity.com/paper/2309.04550/) (2023)
- [Generative AI in Medicine](https://mlsanity.com/paper/2412.10337/) (2024)
- [Recent Advances, Applications and Open Challenges in Machine Learning for Health: Reflections from Research Roundtables at ML4H 2024 Symposium](https://mlsanity.com/paper/2502.06693/) (2025)

## Abstract (arXiv)

The large amount of time clinicians spend sifting through patient notes and documenting in electronic health records (EHRs) is a leading cause of clinician burnout. By proactively and dynamically retrieving relevant notes during the documentation process, we can reduce the effort required to find relevant patient history. In this work, we conceptualize the use of EHR audit logs for machine learning as a source of supervision of note relevance in a specific clinical context, at a particular point in time. Our evaluation focuses on the dynamic retrieval in the emergency department, a high acuity setting with unique patterns of information retrieval and note writing. We show that our methods can achieve an AUC of 0.963 for predicting which notes will be read in an individual note writing session. We additionally conduct a user study with several clinicians and find that our framework can help clinicians retrieve relevant information more efficiently. Demonstrating that our framework and methods can perform well in this demanding setting is a promising proof of concept that they will translate to other clinical settings and data modalities (e.g., labs, medications, imaging).
