A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction
Not on the map. Why?
Abstract (arXiv)
This paper focuses on term-status pair extraction from medical dialogues (MD-TSPE), which is essential in diagnosis dialogue systems and the automatic scribe of electronic medical records (EMRs). In the past few years, works on MD-TSPE have attracted increasing research attention, especially after the remarkable progress made by generative methods. However, these generative methods output a whole sequence consisting of term-status pairs in one stage and ignore integrating prior knowledge, which demands a deeper understanding to model the relationship between terms and infer the status of each term. This paper presents a knowledge-enhanced two-stage generative framework (KTGF) to address the above challenges. Using task-specific prompts, we employ a single model to complete the MD-TSPE through two phases in a unified generative form: we generate all terms the first and then generate the status of each generated term. In this way, the relationship between terms can be learned more effectively from the sequence containing only terms in the first phase, and our designed knowledge-enhanced prompt in the second phase can leverage the category and status candidates of the generated term for status generation. Furthermore, our proposed special status "not mentioned" makes more terms available and enriches the training data in the second phase, which is critical in the low-resource setting. The experiments on the Chunyu and CMDD datasets show that the proposed method achieves superior results compared to the state-of-the-art models in the full training and low-resource settings.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 30 Jul 2023.
Builds on
27 of 51 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2016Layer Normalizationcited by 5,669
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2019How Can We Know What Language Models Know?cited by 959
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
15 more
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 215
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
- 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
- 2019End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosiscited by 70
- 2019UER: An Open-Source Toolkit for Pre-training Modelscited by 62
- 2020Contrastive Triple Extraction with Generative Transformercited by 44
- 2019Extracting Symptoms and their Status from Clinical Conversationscited by 23
- 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
- 2019Learning to Infer Entities, Properties and their Relations from Clinical Conversationscited by 9
- 2023Matching-based Term Semantics Pre-training for Spoken Patient Query Understandingcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 2.
4 papers.
- 2024CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modellingcited by 56
- 2024RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaborationcited by 1
- 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyondcited by 1
- 2025Fine-Tuning DialoGPT on Common Diseases in Rural Nepal for Medical Conversationscited by 0
- 2025Fine-Tuning DialoGPT on Common Diseases in Rural Nepal for Medical Conversations1 Nov 2025
- 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyond28 Feb 2025
- 2024RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration23 Sep 2024
- 2024CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modelling6 Feb 2024