mlsanityData to 14 Oct 2026

A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction

arXiv 2307.16200 ↗First posted 30 Jul 2023cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper focuses on term-status pair extraction from medical dialogues (MD-TSPE), which is essential in diagnosis dialogue systems and the automatic scribe of electronic medical records (EMRs). In the past few years, works on MD-TSPE have attracted increasing research attention, especially after the remarkable progress made by generative methods. However, these generative methods output a whole sequence consisting of term-status pairs in one stage and ignore integrating prior knowledge, which demands a deeper understanding to model the relationship between terms and infer the status of each term. This paper presents a knowledge-enhanced two-stage generative framework (KTGF) to address the above challenges. Using task-specific prompts, we employ a single model to complete the MD-TSPE through two phases in a unified generative form: we generate all terms the first and then generate the status of each generated term. In this way, the relationship between terms can be learned more effectively from the sequence containing only terms in the first phase, and our designed knowledge-enhanced prompt in the second phase can leverage the category and status candidates of the generated term for status generation. Furthermore, our proposed special status "not mentioned" makes more terms available and enriches the training data in the second phase, which is critical in the low-resource setting. The experiments on the Chunyu and CMDD datasets show that the proposed method achieves superior results compared to the state-of-the-art models in the full training and low-resource settings.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 30 Jul 2023.

Builds on

27 of 51 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2016Layer Normalizationcited by 5,669
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  10. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  11. 2019How Can We Know What Language Models Know?cited by 959
  12. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
15 more
  1. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  2. 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 215
  3. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  4. 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
  5. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  6. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  7. 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
  8. 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
  9. 2019End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosiscited by 70
  10. 2019UER: An Open-Source Toolkit for Pre-training Modelscited by 62
  11. 2020Contrastive Triple Extraction with Generative Transformercited by 44
  12. 2019Extracting Symptoms and their Status from Clinical Conversationscited by 23
  13. 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
  14. 2019Learning to Infer Entities, Properties and their Relations from Clinical Conversationscited by 9
  15. 2023Matching-based Term Semantics Pre-training for Spoken Patient Query Understandingcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 2.

4 papers.