mlsanityData to 7 Oct 2026

End-to-end Named Entity Recognition from English Speech

arXiv 2005.11184 ↗First posted 22 May 2020cs.CL cs.LG cs.SDcited by 36

Not on the map. Why?

Abstract (arXiv)

Named entity recognition (NER) from text has been a widely studied problem and usually extracts semantic information from text. Until now, NER from speech is mostly studied in a two-step pipeline process that includes first applying an automatic speech recognition (ASR) system on an audio sample and then passing the predicted transcript to a NER tagger. In such cases, the error does not propagate from one step to another as both the tasks are not optimized in an end-to-end (E2E) fashion. Recent studies confirm that integrated approaches (e.g., E2E ASR) outperform sequential ones (e.g., phoneme based ASR). In this paper, we introduce a first publicly available NER annotated dataset for English speech and present an E2E approach, which jointly optimizes the ASR and NER tagger components. Experimental results show that the proposed E2E approach outperforms the classical two-step approach. We also discuss how NER from speech can be used to handle out of vocabulary (OOV) words in an ASR system.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 7; 2023: 6; 2024: 8; 2025: 9; 2026: 1.

36 papers.

Sort:

By area:

  1. 2021SLUE: New Benchmark Tasks for Spoken Language Understanding Evaluation on Natural Speechcited by 70
  2. 2022SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Taskscited by 34
  3. 2022Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languagescited by 26
  4. 2022AISHELL-NER: Named Entity Recognition from Chinese Speechcited by 19
  5. 2021DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterancescited by 13
  6. 2023CopyNE: Better Contextual ASR by Copying Named Entitiescited by 13
  7. 2021On the Use of External Data for Spoken Named Entity Recognitioncited by 12
  8. 2021Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translationcited by 11
  9. 2022PADA: Pruning Assisted Domain Adaptation for Self-Supervised Speech Representationscited by 10
  10. 2024Failing Forward: Improving Generative Error Correction for ASR with Synthetic Data and Retrieval Augmentationcited by 9
  11. 2024Performance Analysis of Speech Encoders for Low-Resource SLU and ASR in Tunisian Dialectcited by 7
  12. 2021Speech2Slot: An End-to-End Knowledge-based Slot Filling from Speechcited by 6
24 more
  1. 2024Using Large Language Model for End-to-End Chinese ASR and NERcited by 6
  2. 2022Joint Speech Translation and Named Entity Recognitioncited by 5
  3. 2023Visual Information Matters for ASR Error Correctioncited by 3
  4. 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
  5. 2024TokenVerse: Towards Unifying Speech and NLP Tasks via Transducer-based ASRcited by 2
  6. 2024"I've Heard of You!": Generate Spoken Named Entity Recognition Data for Unseen Entitiescited by 2
  7. 2024Medical Spoken Named Entity Recognitioncited by 1
  8. 2024wav2graph: A Framework for Supervised Learning Knowledge Graph from Speechcited by 1
  9. 2025PMF-CEC: Phoneme-augmented Multimodal Fusion for Context-aware ASR Error Correction with Error-specific Selective Decodingcited by 1
  10. 2025NE-PADD: Leveraging Named Entity Knowledge for Robust Partial Audio Deepfake Detection via Attention Aggregationcited by 1
  11. 2025SpeechLLM: Unified Speech and Language Model for Enhanced Multi-Task Understanding in Low Resource Settingscited by 1
  12. 2022Cross-stitched Multi-modal Encoderscited by 0
  13. 2022Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Datacited by 0
  14. 2023E2E Spoken Entity Extraction for Virtual Agentscited by 0
  15. 2023Leveraging Cross-Lingual Transfer Learning in Spoken Named Entity Recognition Systemscited by 0
  16. 2023CPPF: A contextual and post-processing-free model for automatic speech recognitioncited by 0
  17. 2024Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentationcited by 0
  18. 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understandingcited by 0
  19. 2025UniSLU: Unified Spoken Language Understanding from Heterogeneous Cross-Task Datasetscited by 0
  20. 2025Whispering Context: Distilling Syntax and Semantics for Long Speech Transcriptscited by 0
  21. 2025TokenVerse++: Towards Flexible Multitask Learning with Dynamic Task Activationcited by 0
  22. 2025Generative Annotation for ASR Named Entity Correctioncited by 0
  23. 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguationcited by 0
  24. 2026CV-18 NER: Augmented Common Voice for Named Entity Recognition from Arabic Speechcited by 0