mlsanityData to 14 Oct 2026

Improving French Synthetic Speech Quality via SSML Prosody Control

arXiv 2508.17494 ↗First posted 24 Aug 2025cs.CL cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Despite recent advances, synthetic voices often lack expressiveness due to limited prosody control in commercial text-to-speech (TTS) systems. We introduce the first end-to-end pipeline that inserts Speech Synthesis Markup Language (SSML) tags into French text to control pitch, speaking rate, volume, and pause duration. We employ a cascaded architecture with two QLoRA-fine-tuned Qwen 2.5-7B models: one predicts phrase-break positions and the other performs regression on prosodic targets, generating commercial TTS-compatible SSML markup. Evaluated on a 14-hour French podcast corpus, our method achieves 99.2% F1 for break placement and reduces mean absolute error on pitch, rate, and volume by 25-40% compared with prompting-only large language models (LLMs) and a BiLSTM baseline. In perceptual evaluation involving 18 participants across over 9 hours of synthesized audio, SSML-enhanced speech generated by our pipeline significantly improves naturalness, with the mean opinion score increasing from 3.20 to 3.87 (p < 0.005). Additionally, 15 of 18 listeners preferred our enhanced synthesis. These results demonstrate substantial progress in bridging the expressiveness gap between synthetic and natural French speech. Our code is publicly available at https://github.com/hi-paris/Prosody-Control-French-TTS.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 24 Aug 2025.

Builds on

17 of 24 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  4. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
  5. 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
  6. 2025Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audiocited by 31
  7. 2021Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesiscited by 12
  8. 2020Prosodic Representation Learning and Contextual Sampling for Neural Text-to-Speechcited by 10
  9. 2022BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language modelcited by 10
  10. 2021Emphasis control for parallel neural TTScited by 9
  11. 2022Language Model-Based Emotion Prediction Methods for Emotional Speech Synthesis Systemscited by 9
  12. 2021Supervised and Unsupervised Approaches for Controlling Narrow Lexical Focus in Sequence-to-Sequence Speech Synthesiscited by 8
5 more
  1. 2025DrawSpeech: Expressive Speech Synthesis Using Prosodic Sketches as Control Conditionscited by 6
  2. 2023PSST! Prosodic Speech Segmentation with Transformerscited by 5
  3. 2023EE-TTS: Emphatic Expressive TTS with Linguistic Informationcited by 4
  4. 2023An investigation of phrase break prediction in an End-to-End TTS systemcited by 2
  5. 2023Going Retro: Astonishingly Simple Yet Effective Rule-based Prosody Modelling for Speech Synthesis Simulating Emotion Dimensionscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.