Extracting Biomedical Entities from Noisy Audio Transcripts
Not on the map. Why?
Abstract (arXiv)
Automatic Speech Recognition (ASR) technology is fundamental in transcribing spoken language into text, with considerable applications in the clinical realm, including streamlining medical transcription and integrating with Electronic Health Record (EHR) systems. Nevertheless, challenges persist, especially when transcriptions contain noise, leading to significant drops in performance when Natural Language Processing (NLP) models are applied. Named Entity Recognition (NER), an essential clinical task, is particularly affected by such noise, often termed the ASR-NLP gap. Prior works have primarily studied ASR's efficiency in clean recordings, leaving a research gap concerning the performance in noisy environments. This paper introduces a novel dataset, BioASR-NER, designed to bridge the ASR-NLP gap in the biomedical domain, focusing on extracting adverse drug reactions and mentions of entities from the Brief Test of Adult Cognition by Telephone (BTACT) exam. Our dataset offers a comprehensive collection of almost 2,000 clean and noisy recordings. In addressing the noise challenge, we present an innovative transcript-cleaning method using GPT4, investigating both zero-shot and few-shot methodologies. Our study further delves into an error analysis, shedding light on the types of errors in transcription software, corrections by GPT4, and the challenges GPT4 faces. This paper aims to foster improved understanding and potential solutions for the ASR-NLP gap, ultimately supporting enhanced healthcare documentation practices.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 49 references that are in the map. First posted on arXiv 26 Mar 2024.
Builds on
16 of 49 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 169
- 2023GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Informationcited by 117
- 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
- 2020HunFlair: An Easy-to-Use Tool for State-of-the-Art Biomedical Named Entity Recognitioncited by 26
- 2020Inexpensive Domain Adaptation of Pretrained Language Models: Case Studies on Biomedical NER and Covid-19 QAcited by 23
- 2022Few-shot learning for medical text: A systematic reviewcited by 13
4 more
- 2020Effective Unsupervised Domain Adaptation with Adversarially Trained Language Modelscited by 12
- 2022Hardness-guided domain adaptation to recognise biomedical named entities under low-resource scenarioscited by 6
- 2023BioAug: Conditional Generation based Data Augmentation for Low-Resource Biomedical NERcited by 5
- 2022Improving Speech Recognition for Indic Languages using Language Modelcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.