mlsanityData to 14 Oct 2026

DualSpeech: Enhancing Speaker-Fidelity and Text-Intelligibility Through Dual Classifier-Free Guidance

arXiv 2408.14423 ↗First posted 26 Aug 2024eess.AS cs.SDcited by 11

Not on the map. Why?

Abstract (arXiv)

Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despite these advancements, achieving an optimal balance between speaker-fidelity and text-intelligibility remains a challenge, particularly when diverse control demands are considered. Addressing this, we introduce DualSpeech, a TTS model that integrates phoneme-level latent diffusion with dual classifier-free guidance. This approach enables exceptional control over speaker-fidelity and text-intelligibility. Experimental results demonstrate that by utilizing the sophisticated control, DualSpeech surpasses existing state-of-the-art TTS models in performance. Demos are available at https://bit.ly/48Ewoib.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Aug 2024.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 4.

11 papers.

  1. 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 41
  2. 2025ViSAGe: Video-to-Spatial Audio Generationcited by 11
  3. 2025Selective Classifier-free Guidance for Zero-shot Text-to-speechcited by 4
  4. 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech Systemcited by 2
  5. 2025Length-Aware Rotary Position Embedding for Text-Speech Alignmentcited by 2
  6. 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidancescited by 1
  7. 2026Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTScited by 1
  8. 2024Super Monotonic Alignment Searchcited by 0
  9. 2026RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matchingcited by 0
  10. 2026Learnable Classifier-Free Guidance Null Embeddings for Enhanced Controllable Speech Synthesiscited by 0
  11. 2026Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Data
  2. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
  3. 2021On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis
  4. 2026LongCat-AudioDiT: High-Fidelity Diffusion Text-to-Speech in the Waveform Latent Space
  5. 2026Training a Compact, Strong, and Realistic Text-to-Speech Model
  6. 2023VoiceLDM: Text-to-Speech with Environmental Context
  7. 2024SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Models
  8. 2026Combining Masked Language Modeling and Cross-Modal Contrastive Learning for Prosody-Aware TTS ↗