Synthesizing the Lombard Effect: Multi-Level Control of Speech Clarity and Vocal Effort in TTS
Not on the map. Why?
Abstract (arXiv)
Humans tend to speak louder and clearer in challenging environments, such as noisy conditions or when addressing hearingimpaired listeners, which is called Lombard effect. To simulate this behavior in speech synthesis systems, we introduce a flow-matching based text-to-speech (TTS) model trained with vocal effort and articulation pseudo-labels. The proposed model achieves continuous and disentangled control of vocal effort and articulation, while also enabling word-level emphasis for clarifying specific segments of an utterance. Experimental results show that these control mechanisms effectively improve clarityrelated acoustic features. Furthermore, speech-in-noise experiments demonstrate that our model successfully simulates the intelligibility gains of human clear speech in noisy conditions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 29 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
9 of 29 references.
References · 9
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
- 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 145
- 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 98
- 2020Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style Conversioncited by 6
- 2021Whispered and Lombard Neural Speech Synthesiscited by 6
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognitioncited by 5
- 2022Vocal effort modeling in neural TTS for improving the intelligibility of synthetic speech in noisecited by 3
- 2020Analysis and Synthesis of Hypo and Hyperarticulated Speechcited by 2
- 2025Voice Conversion for Lombard Speaking Style with Implicit and Explicit Acoustic Feature Conditioningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Articulatory Source-Filter TTS: Physically Grounded Control through Vocal Tract Kinematics ↗
- 2024DualSpeech: Enhancing Speaker-Fidelity and Text-Intelligibility Through Dual Classifier-Free Guidance
- 2024Hierarchical Control of Emotion Rendering in Speech Synthesis
- 2026Training a Compact, Strong, and Realistic Text-to-Speech Model
- 2026FineCombo-TTS: Collaborative and Precise Controllable Speech Synthesis Using Text Descriptions and Reference Speech ↗
- 2025TTS-CtrlNet: Time varying emotion aligned text-to-speech generation with ControlNet
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning
- 2024Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback