mlsanityData to 13 Oct 2026

EMRModel: A Large Language Model for Extracting Medical Consultation Dialogues into Structured Medical Records

arXiv 2504.16448 ↗First posted 23 Apr 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Medical consultation dialogues contain critical clinical information, yet their unstructured nature hinders effective utilization in diagnosis and treatment. Traditional methods, relying on rule-based or shallow machine learning techniques, struggle to capture deep and implicit semantics. Recently, large pre-trained language models and Low-Rank Adaptation (LoRA), a lightweight fine-tuning method, have shown promise for structured information extraction. We propose EMRModel, a novel approach that integrates LoRA-based fine-tuning with code-style prompt design, aiming to efficiently convert medical consultation dialogues into structured electronic medical records (EMRs). Additionally, we construct a high-quality, realistically grounded dataset of medical consultation dialogues with detailed annotations. Furthermore, we introduce a fine-grained evaluation benchmark for medical consultation information extraction and provide a systematic evaluation methodology, advancing the optimization of medical natural language processing (NLP) models. Experimental results show EMRModel achieves an F1 score of 88.1%, improving by49.5% over standard pre-trained models. Compared to traditional LoRA fine-tuning methods, our model shows superior performance, highlighting its effectiveness in structured medical record extraction tasks.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 12 of its 23 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

12 of 23 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,106
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
  3. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  4. 2023Using an LLM to Help With Code Understandingcited by 227
  5. 2023Large Language Models for Generative Information Extraction: A Surveycited by 184
  6. 2023QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Modelscited by 155
  7. 2023CodeIE: Large Code Generation Models are Better Few-Shot Information Extractorscited by 68
  8. 2023Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosiscited by 30
  9. 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
  10. 2024C-ICL: Contrastive In-context Learning for Information Extractioncited by 22
  11. 2023Code-Style In-Context Learning for Knowledge-Based Question Answeringcited by 13
  12. 2024CoCoP: Enhancing Text Classification with LLM through Code Completion Promptcited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.