mlsanityData to 14 Oct 2026

Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition

arXiv 2205.03433 ↗First posted 6 May 2022cs.SD cs.LG eess.AScited by 62

Not on the map. Why?

Abstract (arXiv)

Recognizing human non-speech vocalizations is an important task and has broad applications such as automatic sound transcription and health condition monitoring. However, existing datasets have a relatively small number of vocal sound samples or noisy labels. As a consequence, state-of-the-art audio event classification models may not perform well in detecting human vocal sounds. To support research on building robust and accurate vocal sound recognition, we have created a VocalSound dataset consisting of over 21,000 crowdsourced recordings of laughter, sighs, coughs, throat clearing, sneezes, and sniffs from 3,365 unique subjects. Experiments show that the vocal sound recognition performance of a model can be significantly improved by 41.9% by adding VocalSound dataset to an existing dataset as training material. In addition, different from previous datasets, the VocalSound dataset contains meta information such as speaker age, gender, native language, country, and health condition.

Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 6 May 2022.

Builds on

13 of 23 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  4. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
  5. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  6. 2021PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregationcited by 82
  7. 2020Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Datacited by 60
  8. 2020The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithmscited by 59
  9. 2020AI4COVID-19: AI Enabled Preliminary Diagnosis for COVID-19 from Cough Samples via an Appcited by 48
  10. 2021The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primatescited by 32
  11. 2020Cough Against COVID: Evidence of COVID-19 Signature in Cough Soundscited by 24
  12. 2018A Closer Look at Weak Label Learning for Audio Eventscited by 12
1 more
  1. 2020Addressing Missing Labels in Large-Scale Sound Event Recognition Using a Teacher-Student Framework With Loss Maskingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 11; 2025: 29; 2026: 19.

62 papers.

Sort:

By area:

  1. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  2. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  3. 2024Qwen2-Audio Technical Reportcited by 560
  4. 2025Kimi-Audio Technical Reportcited by 222
  5. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 110
  6. 2025Step-Audio 2 Technical Reportcited by 105
  7. 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 102
  8. 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 50
  9. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
  10. 2024Can Large Audio-Language Models Truly Hear? Tackling Hallucinations with Multi-Task Assessment and Stepwise Audio Reasoningcited by 31
  11. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 29
  12. 2024Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advancescited by 26
38 more
  1. 2025LongCat-Flash-Omni Technical Reportcited by 26
  2. 2025Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localizationcited by 18
  3. 2025Audio-JEPA: Joint-Embedding Predictive Architecture for Audio Representation Learningcited by 17
  4. 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizationscited by 15
  5. 2025OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academiacited by 13
  6. 2025Teaching Audio-Aware Large Language Models What Does Not Hear: Mitigating Hallucinations through Synthesized Negative Samplescited by 11
  7. 2026ERNIE 5.0 Technical Reportcited by 11
  8. 2022On Out-of-Distribution Detection for Audio with Deep Nearest Neighborscited by 9
  9. 2024MINER: Mining the Underlying Pattern of Modality-Specific Neurons in Multimodal Large Language Modelscited by 7
  10. 2025Soundwave: Less is More for Speech-Text Alignment in LLMscited by 7
  11. 2025From Alignment to Advancement: Bootstrapping Audio-Language Alignment with Synthetic Datacited by 7
  12. 2025StressTest: Can YOUR Speech LM Handle the Stress?cited by 7
  13. 2025MagiCodec: Simple Masked Gaussian-Injected Codec for High-Fidelity Reconstruction and Generationcited by 7
  14. 2026VoxPrivacy: A Benchmark for Evaluating Interactional Privacy of Speech Language Modelscited by 7
  15. 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understandingcited by 6
  16. 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Modelscited by 6
  17. 2026AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answeringcited by 6
  18. 2025Transformation of audio embeddings into interpretable, concept-based representationscited by 5
  19. 2024Toward Practical Automatic Speech Recognition and Post-Processing: a Call for Explainable Error Benchmark Guidelinecited by 4
  20. 2025MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generationcited by 4
  21. 2024DeFT-Mamba: Universal Multichannel Sound Separation and Polyphonic Audio Classificationcited by 3
  22. 2025PAL: Probing Audio Encoders via LLMs -- Audio Information Transfer into LLMscited by 3
  23. 2026Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timingcited by 3
  24. 2024TSPE: Task-Specific Prompt Ensemble for Improved Zero-Shot Audio Classificationcited by 2
  25. 2025DeepInsert: Early Layer Bypass for Efficient and Performant Multimodal Understandingcited by 2
  26. 2025TELEVAL: A Benchmark Designed for Spoken Language Models in Chinese Interactive Scenarioscited by 2
  27. 2026SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classificationcited by 2
  28. 2024D-CAPTCHA++: A Study of Resilience of Deepfake CAPTCHA under Transferable Imperceptible Adversarial Attackcited by 1
  29. 2024Multiple Consistency-guided Test-Time Adaptation for Contrastive Audio-Language Models with Unlabeled Audiocited by 1
  30. 2025Hashing-Baseline: Rethinking Hashing in the Age of Pretrained Modelscited by 1
  31. 2025Think Smart, Not Hard: Difficulty Adaptive Reasoning for Large Audio Language Modelscited by 1
  32. 2025AMAuT: A Flexible and Efficient Multiview Audio Transformer Framework Trained from Scratchcited by 1
  33. 2026Leveraging Prediction Entropy for Automatic Prompt Weighting in Zero-Shot Audio-Language Classificationcited by 1
  34. 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Modelscited by 1
  35. 2026ALARM: Audio-Language Alignment for Reasoning Modelscited by 1
  36. 2026AudioMosaic: Contrastive Masked Audio Representation Learningcited by 1
  37. 2026Dynamic Model Merging Made Slimcited by 1
  38. 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialectscited by 1

50 most cited of 62 All 62 (JSON)