mlsanityData to 14 Oct 2026

FastPitch: Parallel Text-to-speech with Pitch Prediction

arXiv 2006.06873 ↗First posted 11 Jun 2020eess.AS cs.CL cs.LGcited by 151

Not on the map. Why?

Abstract (arXiv)

We present FastPitch, a fully-parallel text-to-speech model based on FastSpeech, conditioned on fundamental frequency contours. The model predicts pitch contours during inference. By altering these predictions, the generated speech can be more expressive, better match the semantic of the utterance, and in the end more engaging to the listener. Uniformly increasing or decreasing pitch with FastPitch generates speech that resembles the voluntary modulation of voice. Conditioning on frequency contours improves the overall quality of synthesized speech, making it comparable to state-of-the-art. It does not introduce an overhead, and FastPitch retains the favorable, fully-parallel Transformer architecture, with over 900x real-time factor for mel-spectrogram synthesis of a typical utterance.

Key facts. Cited by 151 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 21; 2022: 33; 2023: 41; 2024: 32; 2025: 16; 2026: 8.

151 papers.

Sort:

By area:

  1. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  2. 2021A Survey on Neural Speech Synthesiscited by 184
  3. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
  4. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
  5. 2021Text-Free Prosody-Aware Generative Spoken Language Modelingcited by 119
  6. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  7. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 91
  8. 2023Modular Deep Learningcited by 83
  9. 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
  10. 2021One TTS Alignment To Rule Them Allcited by 47
  11. 2023Transformers in Speech Processing: A Surveycited by 39
  12. 2022StyleTTS: A Style-Based Generative Model for Natural and Diverse Text-to-Speech Synthesiscited by 33
38 more
  1. 2023Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Prior for Zero-shot Speaker Adaptationcited by 30
  2. 2021EdiTTS: Score-based Editing for Controllable Text-to-Speechcited by 28
  3. 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
  4. 2022JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speechcited by 26
  5. 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 23
  6. 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
  7. 2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignmentcited by 22
  8. 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
  9. 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
  10. 2021GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesiscited by 18
  11. 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
  12. 2022WavThruVec: Latent speech representation as intermediate features for neural speech synthesiscited by 17
  13. 2023DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Trainingcited by 16
  14. 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
  15. 2023ACE-VC: Adaptive and Controllable Voice Conversion using Explicitly Disentangled Self-supervised Speech Representationscited by 15
  16. 2024TTSDS -- Text-to-Speech Distribution Scorecited by 14
  17. 2021Context-Aware Prosody Correction for Text-Based Speech Editingcited by 13
  18. 2022Heterogeneous Target Speech Separationcited by 13
  19. 2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
  20. 2021FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesiscited by 12
  21. 2021Adapting TTS models For New Speakers using Transfer Learningcited by 12
  22. 2023Let There Be Sound: Reconstructing High Quality Speech from Silent Videoscited by 12
  23. 2024PeriodWave: Multi-Period Flow Matching for High-Fidelity Waveform Generationcited by 12
  24. 2023Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generatorcited by 11
  25. 2023HiFTNet: A Fast High-Quality Neural Vocoder with Harmonic-plus-Noise Filter and Inverse Short Time Fourier Transformcited by 11
  26. 2022Transfer Learning Framework for Low-Resource Text-to-Speech using a Large-Scale Unlabeled Speech Corpuscited by 10
  27. 2022Speaker Anonymization with Phonetic Intermediate Representationscited by 10
  28. 2022Residual Adapters for Few-Shot Text-to-Speech Speaker Adaptationcited by 10
  29. 2022STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agentcited by 9
  30. 2022Audio Deepfake Detection Based on a Combination of F0 Information and Real Plus Imaginary Spectrogram Featurescited by 9
  31. 2022Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakerscited by 9
  32. 2022Evaluating and reducing the distance between synthetic and real speech distributionscited by 9
  33. 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
  34. 2024Controlling Emotion in Text-to-Speech with Natural Language Promptscited by 9
  35. 2024Instruction Data Generation and Unsupervised Adaptation for Speech Language Modelscited by 9
  36. 2021Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesiscited by 8
  37. 2022OverFlow: Putting flows on top of neural transducers for better TTScited by 8
  38. 2024Diffuse or Confuse: A Diffusion Deepfake Speech Datasetcited by 8

50 most cited of 151 All 151 (JSON)