mlsanityData to 7 Oct 2026

FLEURS-R: A Restored Multilingual Speech Corpus for Generation Tasks

arXiv 2408.06227 ↗First posted 12 Aug 2024cs.CL cs.AI cs.SDcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper introduces FLEURS-R, a speech restoration applied version of the Few-shot Learning Evaluation of Universal Representations of Speech (FLEURS) corpus. FLEURS-R maintains an N-way parallel speech corpus in 102 languages as FLEURS, with improved audio quality and fidelity by applying the speech restoration model Miipher. The aim of FLEURS-R is to advance speech technology in more languages and catalyze research including text-to-speech (TTS) and other speech generation tasks in low-resource languages. Comprehensive evaluations with the restored speech and TTS baseline models trained from the new corpus show that the new corpus obtained significantly improved speech quality while maintaining the semantic contents of the speech. The corpus is publicly released via Hugging Face.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 27 of its 30 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

27 of 30 references.

References · 27

  1. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  4. 2022High Fidelity Neural Audio Compressioncited by 673
  5. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  6. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  7. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  8. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  9. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  10. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  11. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 340
  12. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
15 more
  1. 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
  2. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  3. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  4. 2023Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervisioncited by 167
  5. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 106
  6. 2023LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpuscited by 100
  7. 2023InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Promptcited by 90
  8. 2021PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTScited by 52
  9. 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
  10. 2021DF-Conformer: Integrated architecture of Conv-TasNet and Conformer using linear complexity self-attention for speech enhancementcited by 16
  11. 2023CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languagescited by 15
  12. 2022Maestro-U: Leveraging joint speech-text representation learning for zero supervised speech ASRcited by 13
  13. 2022SQuId: Measuring Speech Naturalness in Many Languagescited by 10
  14. 2024Extending Multilingual Speech Synthesis to 100+ Languages without Transcribed Datacited by 9
  15. 2022Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speechcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 6.

13 papers.

Sort:

By area:

  1. 2024AfriHuBERT: A self-supervised speech representation model for African languagescited by 17
  2. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
  3. 2026[b] = [d] - [t] + [p]: Self-supervised Speech Models Discover Phonological Vector Arithmeticcited by 11
  4. 2025UniCoM: A Universal Code-Switching Speech Generatorcited by 2
  5. 2025Finite Scalar Quantization Enables Redundant and Transmission-Robust Neural Audio Compression at Low Bit-ratescited by 2
  6. 2026Sylber 2.0: A Universal Syllable Embeddingcited by 2
  7. 2024Fotheidil: an Automatic Transcription System for the Irish Languagecited by 1
  8. 2025Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restorationcited by 1
  9. 2026OpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languagescited by 1
  10. 2025SAGE-LD: Towards Scalable and Generalizable End-to-End Language Diarization via Simulated Data Augmentationcited by 0
  11. 2026BlasBench: An Open Benchmark for Irish Speech Recognitioncited by 0
  12. 2026Saar-Voice: A Multi-Speaker Saarbr"ucken Dialect Speech Corpuscited by 0
1 more
  1. 2026ZONOS2 Technical Reportcited by 0