mlsanityData to 7 Oct 2026

A Framework for Synthetic Audio Conversations Generation using Large Language Models

arXiv 2409.00946 ↗First posted 2 Sep 2024cs.SD cs.AI eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based dialogues across various topics, which are then converted into audio using text-to-speech (TTS) systems. Our experiments demonstrate that ConversaSynth effectively generates highquality synthetic audio datasets, which can significantly enhance the training and evaluation of models for audio tagging, audio classification, and multi-speaker speech recognition. The results indicate that the synthetic datasets generated by ConversaSynth exhibit substantial diversity and realism, making them suitable for developing robust, adaptable audio-based AI systems.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 18 references that are in the map. First posted on arXiv 2 Sep 2024.

Builds on

17 of 18 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2023A Survey of Large Language Modelscited by 2,537
  7. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  8. 2024Mixtral of Expertscited by 1,785
  9. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  10. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  11. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  12. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
5 more
  1. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  2. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  3. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  4. 2020Continuous speech separation: dataset and analysiscited by 73
  5. 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.