mlsanityData to 14 Oct 2026

Multilingual End-to-End Speech Translation

arXiv 1910.00254 ↗First posted 1 Oct 2019cs.CL eess.AScited by 37

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a simple yet effective framework for multilingual end-to-end speech translation (ST), in which speech utterances in source languages are directly translated to the desired target languages with a universal sequence-to-sequence architecture. While multilingual models have shown to be useful for automatic speech recognition (ASR) and machine translation (MT), this is the first time they are applied to the end-to-end ST problem. We show the effectiveness of multilingual end-to-end ST in two scenarios: one-to-many and many-to-many translations with publicly available data. We experimentally confirm that multilingual end-to-end ST models significantly outperform bilingual ones in both scenarios. The generalization of multilingual training is also evaluated in a transfer learning scenario to a very low-resource language pair. All of our codes and the database are publicly available to encourage further research in this emergent multilingual ST topic.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 9; 2023: 9; 2024: 6; 2025: 3; 2026: 1.

37 papers.

Sort:

By area:

  1. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 140
  2. 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
  3. 2021Learning Shared Semantic Space for Speech-to-Text Translationcited by 49
  4. 2021Large-Scale Self- and Semi-Supervised Learning for Speech Translationcited by 36
  5. 2023SLTUNET: A Simple Unified Model for Sign Language Translationcited by 35
  6. 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translationcited by 28
  7. 2022Revisiting End-to-End Speech-to-Text Translation From Scratchcited by 26
  8. 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
  9. 2023Recent Advances in Direct Speech-to-text Translationcited by 15
  10. 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
  11. 2022A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capabilitycited by 12
  12. 2022Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translationcited by 11
25 more
  1. 2024Cross-Lingual Transfer Learning for Speech Translationcited by 11
  2. 2022LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducerscited by 10
  3. 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
  4. 2024Investigating Decoder-only Large Language Models for Speech-to-text Translationcited by 9
  5. 2024How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representationscited by 9
  6. 2024Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representationcited by 8
  7. 2022Direct Speech Translation for Automatic Subtitlingcited by 7
  8. 2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Taskcited by 6
  9. 2022Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translationcited by 6
  10. 2021Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modelingcited by 5
  11. 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corporacited by 5
  12. 2022Does Joint Training Really Help Cascaded Speech Translation?cited by 5
  13. 2023Towards a Deep Understanding of Multilingual End-to-End Speech Translationcited by 3
  14. 2022Multilingual Simultaneous Speech Translationcited by 2
  15. 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translationcited by 2
  16. 2023End-to-End Single-Channel Speaker-Turn Aware Conversational Speech Translationcited by 2
  17. 2024Zero-Shot End-To-End Spoken Question Answering In Medical Domaincited by 2
  18. 2023Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translationcited by 1
  19. 2024SBAAM! Eliminating Transcript Dependency in Automatic Subtitlingcited by 1
  20. 2026LoASR-Bench: Evaluating Large Speech Language Models on Low-Resource Automatic Speech Recognition Across Language Familiescited by 1
  21. 2021ESPnet-ST IWSLT 2021 Offline Speech Translation Systemcited by 0
  22. 2021Making AI 'Smart': Bridging AI and Cognitive Sciencecited by 0
  23. 2025Joint Training And Decoding for Multilingual End-to-End Simultaneous Speech Translationcited by 0
  24. 2025AdaST: Dynamically Adapting Encoder States in the Decoder for End-to-End Speech-to-Text Translationcited by 0
  25. 2025Whisper-UT: A Unified Translation Framework for Speech and Textcited by 0