mlsanityData to 7 Oct 2026

Cross-lingual Transfer for Speech Processing using Acoustic Language Similarity

arXiv 2111.01326 ↗First posted 2 Nov 2021eess.AS cs.CL cs.SDcited by 8

Not on the map. Why?

Abstract (arXiv)

Speech processing systems currently do not support the vast majority of languages, in part due to the lack of data in low-resource languages. Cross-lingual transfer offers a compelling way to help bridge this digital divide by incorporating high-resource data into low-resource systems. Current cross-lingual algorithms have shown success in text-based tasks and speech-related tasks over some low-resource languages. However, scaling up speech systems to support hundreds of low-resource languages remains unsolved. To help bridge this gap, we propose a language similarity approach that can efficiently identify acoustic cross-lingual transfer pairs across hundreds of languages. We demonstrate the effectiveness of our approach in language family classification, speech recognition, and speech synthesis tasks.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 28 of its 59 references that are in the map. First posted on arXiv 2 Nov 2021.

Builds on

28 of 59 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2020Supervised Contrastive Learningcited by 2,803
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  7. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  8. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  9. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  10. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  11. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  12. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
16 more
  1. 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 210
  2. 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
  3. 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
  4. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  5. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  6. 2019Cross-Lingual Natural Language Generation via Pre-Trainingcited by 63
  7. 2019ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkitcited by 60
  8. 2019Massively Multilingual Adversarial Speech Recognitioncited by 28
  9. 2018Sequence-based Multi-lingual Low Resource Speech Recognitioncited by 20
  10. 2020Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignmentcited by 16
  11. 2020Towards Zero-shot Learning for Automatic Phonemic Transcriptioncited by 14
  12. 2020Improving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translationcited by 14
  13. 2021Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Datacited by 5
  14. 2021SIGTYP 2021 Shared Task: Robust Spoken Language Identificationcited by 5
  15. 2019Multilingual Speech Recognition with Corpus Relatedness Samplingcited by 3
  16. 2020Automatically Identifying Language Family from Acoustic Examples in Low Resource Scenarioscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 4; 2025: 0; 2026: 3.

8 papers.

  1. 2024Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokenscited by 11
  2. 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
  3. 2022When Is TTS Augmentation Through a Pivot Language Useful?cited by 7
  4. 2024How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenariocited by 5
  5. 2024A multilingual training strategy for low resource Text to Speechcited by 3
  6. 2026Sequential Adapter Stacking for Cross-Lingual Low-Resource ASRcited by 1
  7. 2026Continual Adaptation for Pacific Indigenous Speech Recognitioncited by 0
  8. 2026Which Languages Transfer Best to Warlpiri? A Similarity-Based Study for Low-Resource ASRcited by 0