mlsanityData to 14 Oct 2026

CASPER: A Large Scale Spontaneous Speech Dataset

arXiv 2506.00267 ↗First posted 30 May 2025cs.CL cs.SD eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

The success of large language models has driven interest in developing similar speech processing capabilities. However, a key challenge is the scarcity of high-quality spontaneous speech data, as most existing datasets contain scripted dialogues. To address this, we present a novel pipeline for eliciting and recording natural dialogues and release our dataset with 100+ hours of spontaneous speech. Our approach fosters fluid, natural conversations while encouraging a diverse range of topics and interactive exchanges. Unlike traditional methods, it facilitates genuine interactions, providing a reproducible framework for future data collection. This paper introduces our dataset and methodology, laying the groundwork for addressing the shortage of spontaneous speech data. We plan to expand this dataset in future stages, offering a growing resource for the research community.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

24 of 34 references.

References · 24

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  6. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  7. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  8. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 529
  9. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
  10. 2021Generative Spoken Language Modeling from Raw Audiocited by 340
  11. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  12. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
12 more
  1. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  2. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
  3. 2022Generative Spoken Dialogue Language Modelingcited by 126
  4. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 125
  5. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
  6. 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversationscited by 110
  7. 2019End-to-End Neural Speaker Diarization with Permutation-Free Objectivescited by 88
  8. 2021TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global contextcited by 62
  9. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  10. 2024When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detectioncited by 17
  11. 2020MarbleNet: Deep 1D Time-Channel Separable Convolutional Neural Network for Voice Activity Detectioncited by 12
  12. 2023The Casual Conversations v2 Datasetcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

  1. 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialoguecited by 7
  2. 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platformscited by 1
  3. 2026Does a prosody-trained representation help beyond trainable fusion? A parameter-matched study with frozen HuBERTcited by 0
  4. 2026People Making Conversation: Evaluating How Naturally Speech Models Conversecited by 0