mlsanityData to 7 Oct 2026

DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech

arXiv 2207.01063 ↗First posted 3 Jul 2022eess.AS cs.AI cs.CLcited by 67

Not on the map. Why?

Abstract (arXiv)

The majority of current Text-to-Speech (TTS) datasets, which are collections of individual utterances, contain few conversational aspects. In this paper, we introduce DailyTalk, a high-quality conversational speech dataset designed for conversational TTS. We sampled, modified, and recorded 2,541 dialogues from the open-domain dialogue dataset DailyDialog inheriting its annotated attributes. On top of our dataset, we extend prior work as our baseline, where a non-autoregressive TTS is conditioned on historical information in a dialogue. From the baseline experiment with both general and our novel metrics, we show that DailyTalk can be used as a general TTS dataset, and more than that, our baseline can represent contextual information from DailyTalk. The DailyTalk dataset and baseline code are freely available for academic use with CC-BY-SA 4.0 license.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 3 Jul 2022.

Builds on

12 of 19 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  4. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  5. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  6. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  7. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  8. 2021One TTS Alignment To Rule Them Allcited by 47
  9. 2020Conversational End-to-End TTS for Voice Agentcited by 37
  10. 2021STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speechcited by 18
  11. 2021Controllable Context-aware Conversational Speech Synthesiscited by 18
  12. 2021AdaSpeech 3: Adaptive Text to Speech for Spontaneous Stylecited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 7; 2024: 16; 2025: 19; 2026: 24.

67 papers.

Sort:

By area:

  1. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
  2. 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 47
  3. 2024DeSTA2: Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Datacited by 43
  4. 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 40
  5. 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22
  6. 2023Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modelingcited by 17
  7. 2024Generative Expressive Conversational Speech Synthesiscited by 16
  8. 2024CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversationscited by 15
  9. 2024Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Datasetcited by 15
  10. 2024Paralinguistics-Aware Speech-Empowered Large Language Models for Natural Conversationcited by 14
  11. 2025CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matchingcited by 11
  12. 2022FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesiscited by 9
38 more
  1. 2023UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructionscited by 9
  2. 2025OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarioscited by 9
  3. 2023CONCSS: Contrastive-based Context Comprehension for Dialogue-appropriate Prosody in Conversational Speech Synthesiscited by 8
  4. 2025DeepDialogue: A Multi-Turn Emotionally-Rich Spoken Dialogue Datasetcited by 8
  5. 2024Style-Talker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generationcited by 7
  6. 2025DIFFA: Large Language Diffusion Models Can Listen and Understandcited by 7
  7. 2023M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesiscited by 6
  8. 2024DisfluencySpeech -- Single-Speaker Conversational Speech Dataset with Paralanguagecited by 6
  9. 2024Beyond Single-Audio: Advancing Multi-Audio Processing in Audio Large Language Modelscited by 6
  10. 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modelingcited by 6
  11. 2025UniSS: Unified Expressive Speech-to-Speech Translation with Your Voicecited by 6
  12. 2024Can LLMs Understand the Implication of Emphasized Sentences in Dialogue?cited by 5
  13. 2024Intra- and Inter-modal Context Interaction Modeling for Conversational Speech Synthesiscited by 5
  14. 2025DialogueAgents: A Hybrid Agent-Based Speech Synthesis Framework for Multi-Party Dialoguecited by 5
  15. 2025Retrieval-Augmented Dialogue Knowledge Aggregation for Expressive Conversational Speech Synthesiscited by 4
  16. 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
  17. 2026SCENEBench: An Audio Understanding Benchmark Grounded in Assistive and Industrial Use Casescited by 3
  18. 2026Still Between Us? Evaluating and Improving Voice Assistant Robustness to Third-Party Interruptionscited by 3
  19. 2023Cross-speaker Emotion Transfer by Manipulating Speech Style Latentscited by 2
  20. 2023Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speechcited by 2
  21. 2024J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modelingcited by 2
  22. 2025DiffCSS: Diverse and Expressive Conversational Speech Synthesis with Diffusion Modelscited by 2
  23. 2025Contextual Speech Extraction: Leveraging Textual History as an Implicit Cue for Target Speech Extractioncited by 2
  24. 2025Multimodal Fine-grained Context Interaction Graph Modeling for Conversational Speech Synthesiscited by 2
  25. 2025Spoken DialogSum: An Emotion-Rich Conversational Dataset for Spoken Dialogue Summarizationcited by 2
  26. 2025AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuningcited by 2
  27. 2026MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audiocited by 2
  28. 2026Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPOcited by 2
  29. 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Developmentcited by 1
  30. 2025Do We Still Need Audio? Rethinking Speaker Diarization with a Text-Based Approach Using Multiple Prediction Modelscited by 1
  31. 2025TAVID: Text-Driven Audio-Visual Interactive Dialogue Generationcited by 1
  32. 2026Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interactioncited by 1
  33. 2026ALARM: Audio-Language Alignment for Reasoning Modelscited by 1
  34. 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platformscited by 1
  35. 2026AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesiscited by 1
  36. 2023ComedicSpeech: Text To Speech For Stand-up Comedies in Low-Resource Scenarioscited by 0
  37. 2024PRESENT: Zero-Shot Text-to-Prosody Controlcited by 0
  38. 2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generationcited by 0

50 most cited of 67 All 67 (JSON)