Repetition, Not Length: Isolating the Counting Failure in Neural Text-to-Speech
Not on the map. Why?
Abstract (arXiv)
Text-to-speech models loop, truncate and lose count on text that repeats a phrase many times. We show that repetition itself is what breaks them, not the length that comes with it. Every repeated sentence in our test set is paired with a control of matched sentence and word count in which no word ever repeats back-to-back. Six models from three architectures render the controls almost perfectly and fail the repeated twins: 94.3% against 18.2% exactly right at k >= 6. The gap survives greedy decoding, repetition-penalty sweeps, four independent speech recognisers and 420 analysis specifications without once reversing sign; a held-out fourth architecture lands within a point of its predicted gap, and one of two non-autoregressive baselines shows the same failure. Varying the period of the text shows the failure grows smoothly with periodicity, half of it surviving when no word is adjacent to itself.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 22 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
21 of 22 references.
References · 21
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
- 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 288
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2023What Formal Languages Can Transformers Express? A Surveycited by 124
- 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 122
- 2026Qwen3-TTS Technical Reportcited by 118
9 more
- 2024Transformers need glasses! Information over-squashing in language taskscited by 91
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 70
- 2024ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reorderingcited by 50
- 2025(How) Do Language Models Track State?cited by 34
- 2024Counting Ability of Large Language Models and Impact of Tokenizationcited by 32
- 2024RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesiscited by 26
- 2025The Counting Power of Transformerscited by 9
- 2026Repeated-Token Counting Reveals a Dissociation Between Representations and Outputscited by 3
- 2026From Dispersion to Attraction: Spectral Dynamics of Hallucination Across Whisper Model Scalescited by 2
Built on by
Not cited yet.