MUSAN: A Music, Speech, and Noise Corpus
Not on the map. Why?
Cited by 23 in Knowledge distillation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This report introduces a new corpus of music, speech, and noise. This dataset is suitable for training models for voice activity detection (VAD) and music/speech discrimination. Our corpus is released under a flexible Creative Commons license. The dataset consists of music from several genres, speech from twelve languages, and a wide assortment of technical and non-technical noises. We demonstrate use of this corpus for music/speech discrimination on Broadcast news and VAD for speaker identification.
Key facts. Cited by 425 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Oct 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 74; 2023: 66; 2024: 66; 2025: 80; 2026: 88.
425 papers.
Sort:
By area:
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 90
- 2024Best-of-N Jailbreakingcited by 76
- 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
- 2023SpeechX: Neural Codec Language Model as a Versatile Speech Transformercited by 64
- 2024Language Model Can Listen While Speakingcited by 63
- 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 62
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 60
- 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 60
- 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
38 more
- 2021Multilingual and code-switching ASR challenges for low resource Indian languagescited by 53
- 2021Quantifying Bias in Automatic Speech Recognitioncited by 50
- 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 50
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2024The VoicePrivacy 2024 Challenge Evaluation Plancited by 41
- 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 40
- 2022u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modalitycited by 39
- 2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
- 2022VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learningcited by 37
- 2023MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learningcited by 33
- 2025Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audiocited by 31
- 2022Robust Disentangled Variational Speech Representation Learning for Zero-shot Voice Conversioncited by 28
- 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
- 2023Make-A-Voice: Unified Voice Synthesis With Discrete Representationcited by 27
- 2024MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognitioncited by 23
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2022Leveraging Modality-specific Representations for Audio-visual Speech Recognition via Reinforcement Learningcited by 22
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 22
- 2024It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech Recognitioncited by 22
- 2024Speech Robust Bench: A Robustness Benchmark For Speech Recognitioncited by 21
- 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 21
- 2021Utilizing Self-supervised Representations for MOS Predictioncited by 20
- 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
- 2022Look&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancementcited by 20
- 2025FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systemscited by 20
- 2023PromptASR for contextualized ASR with controllable stylecited by 19
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 19
- 2023LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speechcited by 18
- 2021Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularizationcited by 17
- 2022Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptationcited by 17
- 2024Performance evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forwardcited by 17
- 2025VocalBench: Benchmarking the Vocal Conversational Abilities for Speech Interaction Modelscited by 17
- 2025Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representationcited by 17
- 2021Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognitioncited by 16
- 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
- 2022Partially Fake Audio Detection by Self-attention-based Fake Span Discoverycited by 14
- 2023MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognitioncited by 14
- 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
50 most cited of 425 All 425 (JSON)
- 2026Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languages14 Oct 2026
- 2026MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialogue14 Oct 2026
- 2026AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generation10 Oct 2026
- 2026O'ido: Open-Vocabulary Speech Recognition on a 5 Microcontroller without a Neural Accelerator9 Oct 2026
- 2026Breaking Adversarial Transferability in Fine-Tuned Speech Recognition6 Oct 2026
- 2026Revisiting Label-Free Speaker Embedding Enhancement with vMF Profile Likelihood5 Oct 2026
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants5 Oct 2026
- 2026FASTDIAR: Frame-level speaker encoder for Streaming Diarization2 Oct 2026
- 2026Beyond Decodability: Do Acoustic Factors Drive Predictions in Speech-Based Alzheimer's Assessment?1 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026FA-Bench: A Benchmark for Phone- and Word-Level Timestamp Accuracy in Forced Alignment and ASR on Clean and Noisy Speech26 Sep 2026
38 more
- 2026Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation25 Sep 2026
- 2026Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMs25 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations23 Sep 2026
- 2026Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Models23 Sep 2026
- 2026ROAM-ASD: Robust Open-World Active Speaker Detection with Flexible Multimodal Fusion22 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026AURA: Uncertainty-Routed Activation Editing for Acoustic Grounding in Speech Foundation Models21 Sep 2026
- 2026Design of the IBM Granite 5.0 TurboCTC ASR Model17 Sep 2026
- 2026Attention-Guided Reliability Scaling for Contrastive Decoding in Robust Audio-Visual Speech Recognition26 Aug 2026
- 2026The Null Token Knows: Reducing Message-Free Hallucination in ASR and NMT16 Aug 2026
- 2026DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation10 Aug 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Time-Frequency Consistency Learning for Robust Speech Deepfake Detection20 Jul 2026
- 2026VSRo-200: A Romanian Visual Speech Recognition Dataset for Studying Supervision and Multimodal Robustness9 Jul 2026
- 2026MeGA-MP: Metric Graph Advection Message Passing -- A Physics-Informed Message Passing Operator for Advection-Dominated Metric Graphs6 Jul 2026
- 2026C3ASD: Multi-Level Consistency-Driven Representation Learning for Robust Active Speaker Detection3 Jul 2026
- 2026SelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarios2 Jul 2026
- 2026Linguistic Bias Mitigation for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneck30 Jun 2026
- 2026VIB-AVSR: Variational Information Bottleneck for Noise-Robust LLM-Based Audio-Visual Speech Recognition28 Jun 2026
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification28 Jun 2026
- 2026Clustering Unsupervised Representations as Defense against Poisoning Attacks on Speech Commands Classification System27 Jun 2026
- 2026RedVox: Safety and Fairness Gaps in Speech Models Across Languages25 Jun 2026
- 2026VieSpeaker: A Large-Scale Vietnamese Speaker Recognition Dataset Beyond Visual Dependency23 Jun 2026
- 2026The Anatomy of the CTC Oracle Gap: Acoustic Exhaustion and Linguistic Recovery22 Jun 2026
- 2026Kiwano: A Cutting-Edge Open-Source Toolkit for Speaker Verification21 Jun 2026
- 2026CORTIS: Text-Only Adaptation of Spoken Language Models for Task-Oriented Voice Agents19 Jun 2026
- 2026DASH: Dual-View Self-Distillation with Multi-Layer Hidden Representations for Robust Speech Recognition17 Jun 2026
- 2026Dual-Branch Gated Fusion for Open-Set Audio Deepfake Source Tracing8 Jun 2026
- 2026Speaker-Invariant Representation Learning for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneck7 Jun 2026
- 2026A Comparison of SSL-Based Feature Extractors and Back-End Classifiers for Spoofing Detection: A Multi-Corpus Training and Cross-Linguistic Analysis7 Jun 2026
- 2026Assessing the Energy and Carbon Emissions of Neural Speaker Verification Model in Training and Inference6 Jun 2026
- 2026On Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation6 Jun 2026
- 2026Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders5 Jun 2026
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems4 Jun 2026
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement4 Jun 2026
- 2026Audio Interaction Model3 Jun 2026
50 newest of 425 All 425 (JSON)
- 2023Ensemble knowledge distillation of self-supervised speech modelscited by 12
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillationcited by 10
- 2022Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillationcited by 9
- 2022Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillationcited by 6
- 2023Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillationcited by 6
- 2021Voice activity detection in the wild: A data-driven approach using teacher-student trainingcited by 5
- 2022data2vec-aqc: Search for the right Teaching Assistant in the Teacher-Student training setupcited by 5
- 2024Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervisioncited by 5
- 2023Emphasized Non-Target Speaker Knowledge in Knowledge Distillation for Automatic Speaker Verificationcited by 4
- 2022Low-resource Low-footprint Wake-word Detection using Knowledge Distillationcited by 3
- 2023One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verificationcited by 3
- 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruningcited by 3
12 most cited of 22 All 22 (JSON)
- 2026DASH: Dual-View Self-Distillation with Multi-Layer Hidden Representations for Robust Speech Recognition17 Jun 2026
- 2026Sometin Beta Pass Notin: Improving Multilingual ASR for Nigerian Languages via Knowledge Distillation18 May 2026
- 2026Contrastive Knowledge Distillation for Embedding Refinement in Personalized Speech Enhancement21 Jan 2026
- 2026Triage knowledge distillation for speaker verification21 Jan 2026
- 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruning5 Oct 2025
- 2024Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision17 Jun 2024
- 2024Geodesic interpolation of frame-wise speaker embeddings for the diarization of meeting scenarios8 Jan 2024
- 2024Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning3 Jan 2024
- 2023Noise robust distillation of self-supervised speech models via correlation metrics19 Dec 2023
- 2023Emphasized Non-Target Speaker Knowledge in Knowledge Distillation for Automatic Speaker Verification26 Sep 2023
- 2023Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation6 Sep 2023
- 2023Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision5 Aug 2023
12 newest of 22 All 22 (JSON)
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
- 2024Noise-robust Speech Separation with Fast Generative Correctioncited by 9
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalitiescited by 6
- 2025ProSE: Diffusion Priors for Speech Enhancementcited by 3
- 2023Diff-SV: A Unified Hierarchical Framework for Noise-Robust Speaker Verification Using Score-Based Diffusion Probabilistic Modelscited by 2
- 2023Self-supervised learning with diffusion-based multichannel speech enhancement for speaker verification under noisy conditionscited by 0
- 2025SEED: Speaker Embedding Enhancement Diffusion Modelcited by 0
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancementcited by 0
- 2026AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generationcited by 0
- 2026AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generation10 Oct 2026
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement4 Jun 2026
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities29 Sep 2025
- 2025SEED: Speaker Embedding Enhancement Diffusion Model22 May 2025
- 2025ProSE: Diffusion Priors for Speech Enhancement9 Mar 2025
- 2024Noise-robust Speech Separation with Fast Generative Correction11 Jun 2024
- 2023Diff-SV: A Unified Hierarchical Framework for Noise-Robust Speaker Verification Using Score-Based Diffusion Probabilistic Models14 Sep 2023
- 2023Self-supervised learning with diffusion-based multichannel speech enhancement for speaker verification under noisy conditions5 Jul 2023
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement30 Oct 2022
- 2026SpeakerLLM: A Speaker-Specialized Audio-LLM for Speaker Understanding and Verification Reasoningcited by 2
- 2026Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMscited by 1
- 2025Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Modelscited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoningcited by 0
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistantscited by 0
- 2026Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants5 Oct 2026
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMs25 Sep 2026
- 2026SpeakerLLM: A Speaker-Specialized Audio-LLM for Speaker Understanding and Verification Reasoning14 May 2026
- 2025Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models16 Jun 2025
- 2025Beyond Transcription: Mechanistic Interpretability in ASRcited by 13
- 2026AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoderscited by 8
- 2026On the Interpretability of Whisper Encodings Using Sparse Autoencoderscited by 2
- 2026Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoderscited by 2
- 2026Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders5 Jun 2026
- 2026On the Interpretability of Whisper Encodings Using Sparse Autoencoders12 May 2026
- 2026AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoders4 Feb 2026
- 2025Beyond Transcription: Mechanistic Interpretability in ASR21 Aug 2025
- 2025MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognitioncited by 4
- 2022Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Expertscited by 3
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verificationcited by 1
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verification21 Oct 2025
- 2025MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition11 Feb 2025
- 2022Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Experts11 Nov 2022
- 2022Fast and parallel decoding for transducercited by 12
- 2024DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Modelscited by 4
- 2026Design of the IBM Granite 5.0 TurboCTC ASR Modelcited by 0
- 2026Design of the IBM Granite 5.0 TurboCTC ASR Model17 Sep 2026
- 2024DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models8 Jun 2024
- 2022Fast and parallel decoding for transducer31 Oct 2022
- 2024Mamba in Speech: Towards an Alternative to Self-Attentioncited by 60
- 2024Mamba-based Segmentation Model for Speaker Diarizationcited by 4
- 2024Selective State Space Model for Monaural Speech Enhancementcited by 1
- 2024Selective State Space Model for Monaural Speech Enhancement9 Nov 2024
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct 2024
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May 2024
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 90
- 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
- 2023SpeechX: Neural Codec Language Model as a Versatile Speech Transformercited by 64
- 2024Language Model Can Listen While Speakingcited by 63
- 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 62
- 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 60
- 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
- 2021Multilingual and code-switching ASR challenges for low resource Indian languagescited by 53
- 2021Quantifying Bias in Automatic Speech Recognitioncited by 50
12 most cited of 370 All 370 (JSON)
- 2026Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languages14 Oct 2026
- 2026MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialogue14 Oct 2026
- 2026O'ido: Open-Vocabulary Speech Recognition on a 5 Microcontroller without a Neural Accelerator9 Oct 2026
- 2026Breaking Adversarial Transferability in Fine-Tuned Speech Recognition6 Oct 2026
- 2026Revisiting Label-Free Speaker Embedding Enhancement with vMF Profile Likelihood5 Oct 2026
- 2026FASTDIAR: Frame-level speaker encoder for Streaming Diarization2 Oct 2026
- 2026Beyond Decodability: Do Acoustic Factors Drive Predictions in Speech-Based Alzheimer's Assessment?1 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026FA-Bench: A Benchmark for Phone- and Word-Level Timestamp Accuracy in Forced Alignment and ASR on Clean and Noisy Speech26 Sep 2026
- 2026Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation25 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations23 Sep 2026
12 newest of 370 All 370 (JSON)