Training Universal Vocoders with Feature Smoothing-Based Augmentation Methods for High-Quality TTS Systems
Not on the map. Why?
Abstract (arXiv)
While universal vocoders have achieved proficient waveform generation across diverse voices, their integration into text-to-speech (TTS) tasks often results in degraded synthetic quality. To address this challenge, we present a novel augmentation technique for training universal vocoders. Our training scheme randomly applies linear smoothing filters to input acoustic features, facilitating vocoder generalization across a wide range of smoothings. It significantly mitigates the training-inference mismatch, enhancing the naturalness of synthetic output even when the acoustic model produces overly smoothed features. Notably, our method is applicable to any vocoder without requiring architectural modifications or dependencies on specific acoustic models. The experimental results validate the superiority of our vocoder over conventional methods, achieving 11.99% and 12.05% improvements in mean opinion scores when integrated with Tacotron 2 and FastSpeech 2 TTS acoustic models, respectively.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 25 references that are in the map. First posted on arXiv 4 Sep 2024.
Builds on
19 of 25 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2022NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Qualitycited by 151
- 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 97
7 more
- 2021UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generationcited by 71
- 2021SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generationcited by 27
- 2022JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speechcited by 26
- 2022Avocodo: Generative Adversarial Network for Artifact-free Vocodercited by 18
- 2020TTS-by-TTS: TTS-driven Data Augmentation for Fast and High-Quality Speech Synthesiscited by 15
- 2021RefineGAN: Universally Generating Waveform Better than Ground Truth with Highly Accurate Pitch and Intensity Responsescited by 5
- 2022DSPGAN: a GAN-based universal vocoder for high-fidelity TTS by time-frequency domain supervision from DSPcited by 5
Built on by
Not cited yet.