NeurST: Neural Speech Translation Toolkit
Not on the map. Why?
Abstract (arXiv)
NeurST is an open-source toolkit for neural speech translation. The toolkit mainly focuses on end-to-end speech translation, which is easy to use, modify, and extend to advanced speech translation research and products. NeurST aims at facilitating the speech translation research for NLP researchers and building reliable benchmarks for this field. It provides step-by-step recipes for feature extraction, data preprocessing, distributed training, and evaluation. In this paper, we will introduce the framework design of NeurST and show experimental results for different benchmark datasets, which can be regarded as reliable baselines for future research. The toolkit is publicly available at https://github.com/bytedance/neurst/ and we will continuously update the performance of NeurST with other counterparts and studies at https://st-benchmark.github.io/.
Key facts. Cited by 23 papers in the map (data through 13 Oct 2026). First posted on arXiv 18 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 8; 2024: 2.
23 papers.
Sort:
By area:
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 157
- 2022Cross-modal Contrastive Learning for Speech Translationcited by 61
- 2021End-to-end Speech Translation via Cross-modal Progressive Trainingcited by 47
- 2021Learning When to Translate for Streaming Speechcited by 30
- 2022Revisiting End-to-End Speech-to-Text Translation From Scratchcited by 26
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translationcited by 22
- 2022GigaST: A 10,000-hour Pseudo Speech Translation Corpuscited by 20
- 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
- 2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkitcited by 10
- 2021Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoringcited by 9
- 2021Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediatescited by 9
11 more
- 2023CTC-based Non-autoregressive Speech Translationcited by 9
- 2023End-to-End Speech-to-Text Translation: A Surveycited by 9
- 2022Controlling Styles in Neural Machine Translation with Activation Promptcited by 7
- 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insightscited by 7
- 2022On the Impact of Noises in Crowd-Sourced Data for Speech Translationcited by 6
- 2021The Volctrans Neural Speech Translation System for IWSLT 2021cited by 3
- 2023Visual Information Matters for ASR Error Correctioncited by 3
- 2023Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translationcited by 1
- 2024Conditioning LLMs with Emotion in Neural Machine Translationcited by 1
- 2021The IWSLT 2021 BUT Speech Translation Systemscited by 0
- 2022JoeyS2T: Minimalistic Speech-to-Text Modeling with JoeyNMTcited by 0
- 2024Conditioning LLMs with Emotion in Neural Machine Translation6 Aug 2024
- 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights2 May 2024
- 2023End-to-End Speech-to-Text Translation: A Survey2 Dec 2023
- 2023CTC-based Non-autoregressive Speech Translation27 May 2023
- 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation24 May 2023
- 2023DUB: Discrete Unit Back-translation for Speech Translation19 May 2023
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis10 Apr 2023
- 2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit10 Apr 2023
- 2023Visual Information Matters for ASR Error Correction16 Mar 2023
- 2023Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation21 Feb 2023
- 2022Controlling Styles in Neural Machine Translation with Activation Prompt17 Dec 2022
- 2022JoeyS2T: Minimalistic Speech-to-Text Modeling with JoeyNMT5 Oct 2022
11 more
- 2022On the Impact of Noises in Crowd-Sourced Data for Speech Translation28 Jun 2022
- 2022Revisiting End-to-End Speech-to-Text Translation From Scratch9 Jun 2022
- 2022Cross-modal Contrastive Learning for Speech Translation5 May 2022
- 2022GigaST: A 10,000-hour Pseudo Speech Translation Corpus8 Apr 2022
- 2021Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates27 Sep 2021
- 2021Learning When to Translate for Streaming Speech15 Sep 2021
- 2021Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring9 Sep 2021
- 2021The IWSLT 2021 BUT Speech Translation Systems13 Jul 2021
- 2021The Volctrans Neural Speech Translation System for IWSLT 202116 May 2021
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks2 May 2021
- 2021End-to-end Speech Translation via Cross-modal Progressive Training21 Apr 2021
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 157
- 2022Cross-modal Contrastive Learning for Speech Translationcited by 61
- 2021End-to-end Speech Translation via Cross-modal Progressive Trainingcited by 47
- 2021Learning When to Translate for Streaming Speechcited by 30
- 2022Revisiting End-to-End Speech-to-Text Translation From Scratchcited by 26
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translationcited by 22
- 2022GigaST: A 10,000-hour Pseudo Speech Translation Corpuscited by 20
- 2023DUB: Discrete Unit Back-translation for Speech Translationcited by 18
- 2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkitcited by 10
- 2021Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoringcited by 9
- 2021Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediatescited by 9
12 most cited of 22 All 22 (JSON)
- 2024Conditioning LLMs with Emotion in Neural Machine Translation6 Aug 2024
- 2023End-to-End Speech-to-Text Translation: A Survey2 Dec 2023
- 2023CTC-based Non-autoregressive Speech Translation27 May 2023
- 2023CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation24 May 2023
- 2023DUB: Discrete Unit Back-translation for Speech Translation19 May 2023
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis10 Apr 2023
- 2023ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit10 Apr 2023
- 2023Visual Information Matters for ASR Error Correction16 Mar 2023
- 2023Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation21 Feb 2023
- 2022Controlling Styles in Neural Machine Translation with Activation Prompt17 Dec 2022
- 2022JoeyS2T: Minimalistic Speech-to-Text Modeling with JoeyNMT5 Oct 2022
- 2022On the Impact of Noises in Crowd-Sourced Data for Speech Translation28 Jun 2022
12 newest of 22 All 22 (JSON)