mlsanityData to 7 Oct 2026

The IMS Toucan System for the Blizzard Challenge 2023

arXiv 2310.17499 ↗First posted 26 Oct 2023cs.CL cs.LG eess.AScited by 6

Not on the map. Why?

Abstract (arXiv)

For our contribution to the Blizzard Challenge 2023, we improved on the system we submitted to the Blizzard Challenge 2021. Our approach entails a rule-based text-to-phoneme processing system that includes rule-based disambiguation of homographs in the French language. It then transforms the phonemes to spectrograms as intermediate representations using a fast and efficient non-autoregressive synthesis architecture based on Conformer and Glow. A GAN based neural vocoder that combines recent state-of-the-art approaches converts the spectrogram to the final wave. We carefully designed the data processing, training, and inference procedures for the challenge data. Our system identifier is G. Open source code and demo are available.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 26 Oct 2023.

Builds on

27 of 44 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  5. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  6. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  7. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  8. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  9. 2019CamemBERT: a Tasty French Language Modelcited by 368
  10. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  11. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 269
  12. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 257
15 more
  1. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  2. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 233
  3. 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 150
  4. 2020End-to-End Adversarial Text-to-Speechcited by 77
  5. 2021PortaSpeech: Portable and High-Quality Generative Text-to-Speechcited by 47
  6. 2022AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarioscited by 41
  7. 2022VoiceFixer: A Unified Framework for High-Fidelity Speech Restorationcited by 37
  8. 2023A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speechcited by 22
  9. 2023Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representationscited by 22
  10. 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
  11. 2021DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021cited by 19
  12. 2022Avocodo: Generative Adversarial Network for Artifact-free Vocodercited by 18
  13. 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
  14. 2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
  15. 2022PoeticTTS -- Controllable Poetry Reading for Literary Studiescited by 5

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 2.

6 papers.

  1. 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
  2. 2024Controlling Emotion in Text-to-Speech with Natural Language Promptscited by 8
  3. 2024NTU-NPU System for Voice Privacy 2024 Challengecited by 6
  4. 2024Probing the Feasibility of Multilingual Speaker Anonymizationcited by 5
  5. 2025Investigating Stochastic Methods for Prosody Modeling in Speech Synthesiscited by 2
  6. 2025Perceptual implications of automatic anonymization in pathological speechcited by 0