mlsanityData to 7 Oct 2026

GigaST: A 10,000-hour Pseudo Speech Translation Corpus

arXiv 2204.03939 ↗First posted 8 Apr 2022cs.CL cs.SD eess.AScited by 20

Not on the map. Why?

Abstract (arXiv)

This paper introduces GigaST, a large-scale pseudo speech translation (ST) corpus. We create the corpus by translating the text in GigaSpeech, an English ASR corpus, into German and Chinese. The training set is translated by a strong machine translation system and the test set is translated by human. ST models trained with an addition of our corpus obtain new state-of-the-art results on the MuST-C English-German benchmark test set. We provide a detailed description of the translation process and verify its quality. We make the translated text data public and hope to facilitate research in speech translation. Additionally, we also release the training scripts on NeurST to make it easy to replicate our systems. GigaST dataset is available at https://st-benchmark.github.io/resources/GigaST.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 8 Apr 2022.

Builds on

20 of 28 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  7. 2016Sequence-Level Knowledge Distillationcited by 761
  8. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
  9. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  10. 2020fairseq S2T: Fast Speech-to-Text Modeling with fairseqcited by 174
  11. 2016Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translationcited by 113
  12. 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
8 more
  1. 2018Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluationcited by 88
  2. 2017Evaluating Discourse Phenomena in Neural Machine Translationcited by 87
  3. 2020ESPnet-ST: All-in-One Speech Translation Toolkitcited by 82
  4. 2019End-to-End Speech Translation with Knowledge Distillationcited by 58
  5. 2018Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translationcited by 57
  6. 2017Ensemble Distillation for Neural Machine Translationcited by 39
  7. 2020NeurST: Neural Speech Translation Toolkitcited by 23
  8. 2020The Volctrans Machine Translation System for WMT20cited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 8; 2025: 2; 2026: 3.

20 papers.

Sort:

By area:

  1. 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
  2. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  3. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  4. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  5. 2023Speech Translation with Large Language Models: An Industrial Practicecited by 28
  6. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
  7. 2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
  8. 2022M3ST: Mix at Three Levels for Speech Translationcited by 21
  9. 2024Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agentcited by 14
  10. 2022LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducerscited by 10
  11. 2024On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Modelscited by 10
  12. 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
8 more
  1. 2024MELD-ST: An Emotion-aware Speech Translation Datasetcited by 4
  2. 2025When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translationcited by 4
  3. 2023Improving speech translation by fusing speech and textcited by 3
  4. 2024FFSTC: Fongbe to French Speech Translation Corpuscited by 3
  5. 2024A Comparative Study of Discrete Speech Tokens for Semantic-Related Tasks with Large Language Modelscited by 3
  6. 2026MoVE: Translating Laughter and Tears via Mixture of Vocalization Experts in Speech-to-Speech Translationcited by 0
  7. 2026FBK's Long-form SpeechLLMs for IWSLT 2026 Instruction Followingcited by 0
  8. 2026NAVER LABS Europe Submission to the Instruction-following 2026 Short Trackcited by 0