mlsanityData to 7 Oct 2026

Automated speech tools for helping communities process restricted-access corpora for language revival efforts

arXiv 2204.07272 ↗First posted 15 Apr 2022cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

Many archival recordings of speech from endangered languages remain unannotated and inaccessible to community members and language learning programs. One bottleneck is the time-intensive nature of annotation. An even narrower bottleneck occurs for recordings with access constraints, such as language that must be vetted or filtered by authorised community members before annotation can begin. We propose a privacy-preserving workflow to widen both bottlenecks for recordings where speech in the endangered language is intermixed with a more widely-used language such as English for meta-linguistic commentary and questions (e.g. What is the word for 'tree'?). We integrate voice activity detection (VAD), spoken language identification (SLI), and automatic speech recognition (ASR) to transcribe the metalinguistic content, which an authorised person can quickly scan to triage recordings that can be annotated by people with lower levels of access. We report work-in-progress processing 136 hours archival audio containing a mix of English and Muruwari. Our collaborative work with the Muruwari custodian of the archival materials show that this workflow reduces metalanguage transcription time by 20% even given only minimal amounts of annotated training data: 10 utterances per language for SLI and for ASR at most 39 minutes, and possibly as little as 39 seconds.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 15 Apr 2022.

Builds on

10 of 27 references.

References · 10

  1. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  2. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  3. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
  4. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  5. 2020Probing Acoustic Representations for Phonetic Propertiescited by 26
  6. 2021Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yolox'ochitl Mixteccited by 15
  7. 2021Leveraging pre-trained representations to improve access to untranscribed speech from endangered languagescited by 8
  8. 2021SIGTYP 2021 Shared Task: Robust Spoken Language Identificationcited by 5
  9. 2020Enabling Interactive Transcription in an Indigenous Communitycited by 4
  10. 2017Transcribing Against Timecited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1.

3 papers.