The fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, task and baselines
Not on the map. Why?
Abstract (arXiv)
The CHiME challenge series aims to advance robust automatic speech recognition (ASR) technology by promoting research at the interface of speech and language processing, signal processing , and machine learning. This paper introduces the 5th CHiME Challenge, which considers the task of distant multi-microphone conversational ASR in real home environments. Speech material was elicited using a dinner party scenario with efforts taken to capture data that is representative of natural conversational speech and recorded by 6 Kinect microphone arrays and 4 binaural microphone pairs. The challenge features a single-array track and a multiple-array track and, for each track, distinct rankings will be produced for systems focusing on robustness with respect to distant-microphone capture vs. systems attempting to address all aspects of the task including conversational language modeling. We discuss the rationale for the challenge and provide a detailed description of the data collection procedure, the task, and the baseline systems for array synchronization, speech enhancement, and conventional and end-to-end ASR.
Key facts. Cited by 92 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 22; 2023: 17; 2024: 6; 2025: 13; 2026: 12.
92 papers.
Sort:
By area:
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 31
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancementcited by 30
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 22
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 21
- 2024Speech Robust Bench: A Robustness Benchmark For Speech Recognitioncited by 21
- 2022SPIRAL: Self-supervised Perturbation-Invariant Representation Learning for Speech Pre-Trainingcited by 19
- 2021End-to-End Multi-Channel Transformer for Speech Recognitioncited by 17
38 more
- 2022Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptationcited by 17
- 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systemscited by 15
- 2021ASR4REAL: An extended benchmark for speech modelscited by 14
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2022Insights Into Deep Non-linear Filters for Improved Multi-channel Speech Enhancementcited by 14
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairnesscited by 13
- 2023One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognitioncited by 12
- 2023Adapting Multi-Lingual ASR Models for Handling Multiple Talkerscited by 11
- 2021RyanSpeech: A Corpus for Conversational Text-to-Speech Synthesiscited by 10
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
- 2021Multi-turn RNN-T for streaming recognition of multi-party speechcited by 10
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separationcited by 9
- 2021ASR-GLUE: A New Multi-task Benchmark for ASR-Robust Natural Language Understandingcited by 9
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systemscited by 9
- 2025SoloSpeech: Enhancing Intelligibility and Quality in Target Speech Extraction through a Cascaded Generative Pipelinecited by 9
- 2021Multi-Channel Transformer Transducer for Speech Recognitioncited by 8
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractorscited by 8
- 2022Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarizationcited by 7
- 2022Improving generalizability of distilled self-supervised speech processing models under distorted settingscited by 7
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridgecited by 7
- 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Taskscited by 7
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialoguecited by 7
- 2022A Conformer Based Acoustic Model for Robust Automatic Speech Recognitioncited by 6
- 2023On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settingscited by 6
- 2021Dynamic curriculum learning via data parameters for noise robust keyword spottingcited by 5
- 2021Directed Speech Separation for Automatic Speech Recognition of Long Form Conversational Speechcited by 5
- 2022MetricGAN+/-: Increasing Robustness of Noise Reduction on Unseen Datacited by 5
- 2022A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetingscited by 5
- 2023Lightweight Toxicity Detection in Spoken Language: A Transformer-based Approach for Edge Devicescited by 5
- 2023BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASRcited by 5
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognitioncited by 5
- 2021STRODE: Stochastic Boundary Ordinary Differential Equationcited by 4
- 2022Integrating Statistical Uncertainty into Neural Network-Based Speech Enhancementcited by 4
- 2023Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environmentscited by 4
- 2025Steering Deep Non-Linear Spatially Selective Filters for Weakly Guided Extraction of Moving Speakers in Dynamic Scenarioscited by 4
- 2025A Cocktail-Party Benchmark: Multi-Modal dataset and Comparative Evaluation Resultscited by 4
- 2026From Reactive to Proactive: Assessing the Proactivity of Voice Agents via ProVoice-Benchcited by 4
- 2021MultiSV: Dataset for Far-Field Multi-Channel Speaker Verificationcited by 3
50 most cited of 92 All 92 (JSON)
- 2026FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs30 Sep 2026
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue25 Aug 2026
- 2026DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation10 Aug 2026
- 2026On the Role of Conversational Timing in Synthetic Training Data for ASR9 Jul 2026
- 2026From Reactive to Proactive: Assessing the Proactivity of Voice Agents via ProVoice-Bench16 Apr 2026
- 2026Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking15 Apr 2026
- 2026Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers24 Mar 2026
- 2026Dr. SHAP-AV: Decoding Relative Modality Contributions via Shapley Attribution in Audio-Visual Speech Recognition12 Mar 2026
- 2026SQuTR: A Robustness Benchmark for Spoken Query to Text Retrieval under Acoustic Noise13 Feb 2026
- 2026RIR-Mega-Speech: A Reverberant Speech Corpus with Comprehensive Acoustic Metadata and Reproducible Evaluation25 Jan 2026
- 2026SpatialEmb: Extract and Encode Spatial Information for 1-Stage Multi-channel Multi-speaker ASR on Arbitrary Microphone Arrays25 Jan 2026
- 2026Adaptive Rotary Steering with Joint Autoregression for Robust Extraction of Closely Moving Speakers in Dynamic Scenarios18 Jan 2026
38 more
- 2025A Cocktail-Party Benchmark: Multi-Modal dataset and Comparative Evaluation Results27 Oct 2025
- 2025Automatic Speech Recognition in the Modern Era: Architectures, Training, and Evaluation11 Oct 2025
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASR23 Sep 2025
- 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challenges24 Jul 2025
- 2025Self-Steering Deep Non-Linear Spatially Selective Filters for Efficient Extraction of Moving Speakers under Weak Guidance3 Jul 2025
- 2025Do We Still Need Audio? Rethinking Speaker Diarization with a Text-Based Approach Using Multiple Prediction Models12 Jun 2025
- 2025Challenges in Automated Processing of Speech from Child Wearables: The Case of Voice Type Classifier4 Jun 2025
- 2025SoloSpeech: Enhancing Intelligibility and Quality in Target Speech Extraction through a Cascaded Generative Pipeline25 May 2025
- 2025Steering Deep Non-Linear Spatially Selective Filters for Weakly Guided Extraction of Moving Speakers in Dynamic Scenarios20 May 2025
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition30 Apr 2025
- 2025SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development31 Mar 2025
- 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Tasks19 Feb 2025
- 2025Summary of the NOTSOFAR-1 Challenge: Highlights and Learnings28 Jan 2025
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistants22 Oct 2024
- 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systems10 Sep 2024
- 2024Multimodal Contextualized Semantic Parsing from Speech10 Jun 2024
- 2024Speech Robust Bench: A Robustness Benchmark For Speech Recognition8 Mar 2024
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challenge2 Feb 2024
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription16 Jan 2024
- 2023Lattice Rescoring Based on Large Ensemble of Complementary Neural Language Models20 Dec 2023
- 2023Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environments21 Nov 2023
- 2023One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognition2 Oct 2023
- 2023Convoifilter: A case study of doing cocktail party speech recognition22 Aug 2023
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systems28 Jul 2023
- 2023Joint speech and overlap detection: a benchmark over multiple audio setup and speech domains24 Jul 2023
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios23 Jun 2023
- 2023RescueSpeech: A German Corpus for Speech Recognition in Search and Rescue Domain6 Jun 2023
- 2023On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings5 Jun 2023
- 2023Adapting Multi-Lingual ASR Models for Handling Multiple Talkers30 May 2023
- 2023Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data25 May 2023
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridge23 May 2023
- 2023BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASR23 May 2023
- 2023Lightweight Toxicity Detection in Spoken Language: A Transformer-based Approach for Edge Devices22 Apr 2023
- 2023On Data Sampling Strategies for Training Neural Network Speech Separation Models14 Apr 2023
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement28 Feb 2023
- 2023A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit27 Feb 2023
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairness18 Dec 2022
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration4 Nov 2022
50 newest of 92 All 92 (JSON)
- 2022SPIRAL: Self-supervised Perturbation-Invariant Representation Learning for Speech Pre-Trainingcited by 19
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separationcited by 9
- 2023Lightweight Toxicity Detection in Spoken Language: A Transformer-based Approach for Edge Devicescited by 5
- 2023Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Datacited by 3
- 2023Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data25 May 2023
- 2023Lightweight Toxicity Detection in Spoken Language: A Transformer-based Approach for Edge Devices22 Apr 2023
- 2022SPIRAL: Self-supervised Perturbation-Invariant Representation Learning for Speech Pre-Training25 Jan 2022
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separation15 Jun 2021
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancementcited by 30
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridgecited by 7
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridge23 May 2023
- 2023Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement28 Feb 2023
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration4 Nov 2022
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 31
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 22
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 21
- 2024Speech Robust Bench: A Robustness Benchmark For Speech Recognitioncited by 21
- 2021End-to-End Multi-Channel Transformer for Speech Recognitioncited by 17
- 2022Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptationcited by 17
- 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systemscited by 15
- 2021ASR4REAL: An extended benchmark for speech modelscited by 14
12 most cited of 83 All 83 (JSON)
- 2026FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs30 Sep 2026
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue25 Aug 2026
- 2026DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation10 Aug 2026
- 2026On the Role of Conversational Timing in Synthetic Training Data for ASR9 Jul 2026
- 2026Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers24 Mar 2026
- 2026Dr. SHAP-AV: Decoding Relative Modality Contributions via Shapley Attribution in Audio-Visual Speech Recognition12 Mar 2026
- 2026SQuTR: A Robustness Benchmark for Spoken Query to Text Retrieval under Acoustic Noise13 Feb 2026
- 2026RIR-Mega-Speech: A Reverberant Speech Corpus with Comprehensive Acoustic Metadata and Reproducible Evaluation25 Jan 2026
- 2026SpatialEmb: Extract and Encode Spatial Information for 1-Stage Multi-channel Multi-speaker ASR on Arbitrary Microphone Arrays25 Jan 2026
- 2026Adaptive Rotary Steering with Joint Autoregression for Robust Extraction of Closely Moving Speakers in Dynamic Scenarios18 Jan 2026
- 2025A Cocktail-Party Benchmark: Multi-Modal dataset and Comparative Evaluation Results27 Oct 2025
- 2025Automatic Speech Recognition in the Modern Era: Architectures, Training, and Evaluation11 Oct 2025
12 newest of 83 All 83 (JSON)