# Vocoders and speech synthesis

Area: [Speech and audio language models](https://mlsanity.com/speech/index.md). HTML: https://mlsanity.com/speech/vocoders-and-speech-synthesis/

## Key facts

- Vocoders and speech synthesis: 1,631 papers on arXiv since 2021 (data through 19 Oct 2026).
- 486 of its 1,631 mapped papers (30%) cite “Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers” (2023, arXiv 2301.02111).
- 358 of its 1,631 mapped papers (22%) cite “SoundStream: An End-to-End Neural Audio Codec” (2021, arXiv 2107.03312).
- 28 new papers 2 Oct–19 Oct.

## Most cited here

- [Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers](https://mlsanity.com/paper/2301.02111/) (2023), cited by 486 papers here
- [SoundStream: An End-to-End Neural Audio Codec](https://mlsanity.com/paper/2107.03312/) (2021), cited by 358 papers here
- [Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech](https://mlsanity.com/paper/2106.06103/) (2021), cited by 344 papers here
- [F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching](https://mlsanity.com/paper/2410.06885/) (2024), cited by 242 papers here
- [Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale](https://mlsanity.com/paper/2306.15687/) (2023), cited by 231 papers here
- [CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens](https://mlsanity.com/paper/2407.05407/) (2024), cited by 209 papers here
- [Seed-TTS: A Family of High-Quality Versatile Speech Generation Models](https://mlsanity.com/paper/2406.02430/) (2024), cited by 208 papers here
- [YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone](https://mlsanity.com/paper/2112.02418/) (2021), cited by 193 papers here
- [NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models](https://mlsanity.com/paper/2403.03100/) (2024), cited by 185 papers here
- [Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech](https://mlsanity.com/paper/2105.06337/) (2021), cited by 166 papers here

## New (2 Oct–19 Oct)

- [Steering intonational tunes in text-to-speech synthesis](https://mlsanity.com/paper/2610.27403/) (2026-10-19)
- [SEAM: Spectral Embedding Alignment and Merging for Low-Resource TTS](https://mlsanity.com/paper/2610.26252/) (2026-10-19)
- [MixiSpeech: Progressive State Distillation for One-Step Vietnamese TTS](https://mlsanity.com/paper/2610.25394/) (2026-10-18)
- [ShlokaDhara: A Multi-Speaker Sanskrit Speech Corpus for Learning Meter-Aware Prosody in Text-to-Recitation](https://mlsanity.com/paper/2610.26929/) (2026-10-17)
- [Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTS](https://mlsanity.com/paper/2610.23678/) (2026-10-16)
- [CoSTA: Compressed Speech Token Adaptation for Efficient Spoken Dialogue Models](https://mlsanity.com/paper/2610.21143/) (2026-10-15)
- [Probing Neural Audio Codecs with Speaker Traits and Speech Characteristics](https://mlsanity.com/paper/2610.20955/) (2026-10-14)
- [Revise-TTS: A Non-Masking Refinement Framework for Masked Diffusion Models in Text-to-Speech](https://mlsanity.com/paper/2610.19499/) (2026-10-14)
- [PACT: A Pragmatic Prompting Framework for Expressive and Voice-Preserving Speech-to-Speech Translation](https://mlsanity.com/paper/2610.18247/) (2026-10-13)
- [BridgeCodec: Mamba Enhanced Neural Audio Codec with Schr"odinger Bridge at Low Bitrate](https://mlsanity.com/paper/2610.15453/) (2026-10-11)
- [Training a Compact, Strong, and Realistic Text-to-Speech Model](https://mlsanity.com/paper/2610.14776/) (2026-10-10)
- [VoTSpeech: Decoupling Voice Design from Speech Generation in Instruction-Following TTS](https://mlsanity.com/paper/2610.14694/) (2026-10-10)
- [AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs](https://mlsanity.com/paper/2610.13600/) (2026-10-09)
- [Beyond Speech Captions: Speech-Rewarded Style Planning for Conversational Text-to-Speech](https://mlsanity.com/paper/2610.11461/) (2026-10-08)
- [Edit Who Speaks, Control How They Speak: Global Timbre Editing and Local Instruction Control for TTS](https://mlsanity.com/paper/2610.11437/) (2026-10-08)
- [Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining](https://mlsanity.com/paper/2610.11159/) (2026-10-08)
- [Training-Free Instruction TTS Gender Bias Calibration Using Model-Adaptive Steering](https://mlsanity.com/paper/2610.09831/) (2026-10-07)
- [Beyond Token Revision: Investigating Mask-and-Replace Diffusion for Zero-Shot Text-to-Speech](https://mlsanity.com/paper/2610.09448/) (2026-10-07)
- [Hearing's Blind Spots: Toward Perceptual Compute Allocation in Neural Text-to-Speech](https://mlsanity.com/paper/2610.14056/) (2026-10-06)
- [Loud and Clear: Dynamic Activation Steering for Improving Speech Intelligibility in Noisy Environments](https://mlsanity.com/paper/2610.07647/) (2026-10-06)
- [Pronunciation-Oriented Reinforcement Learning for Japanese Text-to-Speech with Kana-Domain ASR Rewards](https://mlsanity.com/paper/2610.07575/) (2026-10-06)
- [Region-Aware Masking for Accent-Robust Cross-Lingual Text-to-Speech](https://mlsanity.com/paper/2610.07524/) (2026-10-05)
- [Neural Representations, Natural Connections: What Transfers From Human Speech Foundation Models to Animal Vocalizations?](https://mlsanity.com/paper/2610.07107/) (2026-10-05)
- [Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model](https://mlsanity.com/paper/2610.06817/) (2026-10-05)
- [A Comprehensive Objective Evaluation of Modern Text-to-Speech for Turkish Using Speech Quality Assessment Models](https://mlsanity.com/paper/2610.06057/) (2026-10-05)
- [GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding](https://mlsanity.com/paper/2610.04651/) (2026-10-03)
- [DriftTTS: Few-Step Text-to-Speech Without Distillation via Distribution-Matching Drift](https://mlsanity.com/paper/2610.03390/) (2026-10-02)
- [Refinement Buys Intelligibility, Search Buys Identity: What Test-Time Compute Buys in Masked-Diffusion TTS](https://mlsanity.com/paper/2610.03320/) (2026-10-02)
