PeriodNet: A non-autoregressive waveform generation model with a structure separating periodic and aperiodic components
Not on the map. Why?
Abstract (arXiv)
We propose PeriodNet, a non-autoregressive (non-AR) waveform generation model with a new model structure for modeling periodic and aperiodic components in speech waveforms. The non-AR waveform generation models can generate speech waveforms parallelly and can be used as a speech vocoder by conditioning an acoustic feature. Since a speech waveform contains periodic and aperiodic components, both components should be appropriately modeled to generate a high-quality speech waveform. However, it is difficult to decompose the components from a natural speech waveform in advance. To address this issue, we propose a parallel model and a series model structure separating periodic and aperiodic components. The features of our proposed models are that explicit periodic and aperiodic signals are taken as input, and external periodic/aperiodic decomposition is not needed in training. Experiments using a singing voice corpus show that our proposed structure improves the naturalness of the generated waveform. We also show that the speech waveforms with a pitch outside of the training data range can be generated with more naturalness.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 15 Feb 2021.
Builds on
17 of 30 references.
References · 17
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
- 2018Efficient Neural Audio Synthesiscited by 218
- 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
- 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
5 more
- 2018ClariNet: Parallel Wave Generation in End-to-End Text-to-Speechcited by 70
- 2018FloWaveNet : A Generative Flow for Raw Audiocited by 54
- 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
- 2017Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networkscited by 15
- 2020Quasi-Periodic Parallel WaveGAN: A Non-autoregressive Raw Waveform Generative Model with Pitch-dependent Dilated Convolution Neural Networkcited by 8
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 2.
7 papers.
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2021Sinsy: A Deep Neural Network-Based Singing Voice Synthesis Systemcited by 14
- 2022Source-Filter HiFi-GAN: Fast and Pitch Controllable High-Fidelity Neural Vocodercited by 11
- 2022Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesiscited by 6
- 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generationcited by 5
- 2021MSR-NV: Neural Vocoder Using Multiple Sampling Ratescited by 0
- 2023Singing voice synthesis based on frame-level sequence-to-sequence models considering vocal timing deviationcited by 0
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Review7 Jul 2023
- 2023Singing voice synthesis based on frame-level sequence-to-sequence models considering vocal timing deviation5 Jan 2023
- 2022Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesis28 Oct 2022
- 2022Source-Filter HiFi-GAN: Fast and Pitch Controllable High-Fidelity Neural Vocoder27 Oct 2022
- 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generation12 May 2022
- 2021MSR-NV: Neural Vocoder Using Multiple Sampling Rates28 Sep 2021
- 2021Sinsy: A Deep Neural Network-Based Singing Voice Synthesis System5 Aug 2021