NAVER LABS Europe's Multilingual Speech Translation Systems for the IWSLT 2023 Low-Resource Track
Not on the map. Why?
Abstract (arXiv)
This paper presents NAVER LABS Europe's systems for Tamasheq-French and Quechua-Spanish speech translation in the IWSLT 2023 Low-Resource track. Our work attempts to maximize translation quality in low-resource settings using multilingual parameter-efficient solutions that leverage strong pre-trained models. Our primary submission for Tamasheq outperforms the previous state of the art by 7.5 BLEU points on the IWSLT 2022 test set, and achieves 23.6 BLEU on this year's test set, outperforming the second best participant by 7.7 points. For Quechua, we also rank first and achieve 17.7 BLEU, despite having only two hours of translation data. Finally, we show that our proposed multilingual architecture is also competitive for high-resource languages, outperforming the best unconstrained submission to the IWSLT 2021 Multilingual track, despite using much less training data and compute.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 13 Jun 2023.
Builds on
20 of 28 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 298
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 242
8 more
- 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
- 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
- 2021Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapterscited by 21
- 2022Speech Resources in the Tamasheq Languagecited by 13
- 2021Continual Learning in Multilingual NMT via Language-Specific Embeddingscited by 12
- 2021Efficient Inference for Multilingual Neural Machine Translationcited by 10
- 2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Taskcited by 6
- 2022ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Taskscited by 6
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 2; 2026: 1.
9 papers.
- 2023Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Expertscited by 17
- 2024Pushing the Limits of Zero-shot End-to-End Speech Translationcited by 14
- 2025From TOWER to SPIRE: Adding the Speech Modality to a Translation-Specialist LLMcited by 8
- 2024Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systemscited by 5
- 2026SpeechMapper: Speech-to-text Embedding Projector for LLMscited by 4
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translationcited by 2
- 2024Efficient Compression of Multitask Multilingual Speech Modelscited by 2
- 2025IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translationcited by 1
- 2024An Adapter-Based Unified Model for Multiple Spoken Language Processing Taskscited by 0
- 2026SpeechMapper: Speech-to-text Embedding Projector for LLMs28 Jan 2026
- 2025IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation5 Jun 2025
- 2025From TOWER to SPIRE: Adding the Speech Modality to a Translation-Specialist LLM13 Mar 2025
- 2024An Adapter-Based Unified Model for Multiple Spoken Language Processing Tasks20 Jun 2024
- 2024Efficient Compression of Multitask Multilingual Speech Models2 May 2024
- 2024Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems2 Apr 2024
- 2024Pushing the Limits of Zero-shot End-to-End Speech Translation16 Feb 2024
- 2023Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts2 Nov 2023
- 2023How To Build Competitive Multi-gender Speech Translation Models For Controlling Speaker Gender Translation23 Oct 2023