mlsanityData to 7 Oct 2026

Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translation

arXiv 2109.07439 ↗First posted 15 Sep 2021cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Automatic translation systems are known to struggle with rare words. Among these, named entities (NEs) and domain-specific terms are crucial, since errors in their translation can lead to severe meaning distortions. Despite their importance, previous speech translation (ST) studies have neglected them, also due to the dearth of publicly available resources tailored to their specific evaluation. To fill this gap, we i) present the first systematic analysis of the behavior of state-of-the-art ST systems in translating NEs and terminology, and ii) release NEuRoparl-ST, a novel benchmark built from European Parliament speeches annotated with NEs and terminology. Our experiments on the three language directions covered by our benchmark (en->es/fr/it) show that ST systems correctly translate 75-80% of terms and 65-70% of NEs, with very low performance (37-40%) on person names.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 15 Sep 2021.

Builds on

24 of 62 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  7. 2017Six Challenges for Neural Machine Translationcited by 334
  8. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
  9. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
  10. 2017Sequence-to-Sequence Models Can Directly Translate Foreign Speechcited by 121
  11. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  12. 2016Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translationcited by 113
12 more
  1. 2020Speech Translation and the End-to-End Promise: Taking Stock of Where We Arecited by 77
  2. 2019Training Neural Machine Translation To Apply Terminology Constraintscited by 73
  3. 2018Pre-training on high-resource speech recognition improves low-resource speech-to-text translationcited by 70
  4. 2019End-to-End Speech Translation with Knowledge Distillationcited by 58
  5. 2020CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpuscited by 57
  6. 2018Neural Machine Translation Decoding with Terminology Constraintscited by 36
  7. 2020End-to-end Named Entity Recognition from English Speechcited by 36
  8. 2020End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020cited by 31
  9. 2019Improving sequence-to-sequence speech recognition training with on-the-fly data augmentationcited by 29
  10. 2021Facilitating Terminology Translation with Target Lemma Annotationscited by 19
  11. 2018End-to-end named entity extraction from speechcited by 11
  12. 2020On Knowledge Distillation for Direct Speech Translationcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 1; 2024: 2; 2025: 1; 2026: 1.

11 papers.

  1. 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
  2. 2024Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gapscited by 24
  3. 2022Who Are We Talking About? Handling Person Names in Speech Translationcited by 8
  4. 2022Direct Speech Translation for Automatic Subtitlingcited by 7
  5. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
  6. 2022Joint Speech Translation and Named Entity Recognitioncited by 5
  7. 2022Named Entity Detection and Injection for Direct Speech Translationcited by 4
  8. 2024Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approachcited by 3
  9. 2023Robustness of Multi-Source MT to Transcription Errorscited by 2
  10. 2022Open Terminology Management and Sharing Toolkit for Federation of Terminology Databasescited by 0
  11. 2026Measuring User's Mental Models of Speech Translation in Human-AI Collaborationcited by 0