CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Not on the map. Why?
Abstract (arXiv)
Following the success of the 1st, 2nd, 3rd, 4th and 5th CHiME challenges we organize the 6th CHiME Speech Separation and Recognition Challenge (CHiME-6). The new challenge revisits the previous CHiME-5 challenge and further considers the problem of distant multi-microphone conversational speech diarization and recognition in everyday home environments. Speech material is the same as the previous CHiME-5 recordings except for accurate array synchronization. The material was elicited using a dinner party scenario with efforts taken to capture data that is representative of natural conversational speech. This paper provides a baseline description of the CHiME-6 challenge for both segmented multispeaker speech recognition (Track 1) and unsegmented multispeaker speech recognition (Track 2). Of note, Track 2 is the first challenge activity in the community to tackle an unsegmented multispeaker speech recognition scenario with a complete set of reproducible open source baselines providing speech enhancement, speaker diarization, and speech recognition modules.
Key facts. Cited by 132 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 23; 2023: 15; 2024: 22; 2025: 24; 2026: 28.
132 papers.
Sort:
By area:
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2021BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognitioncited by 88
- 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
- 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
- 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 62
- 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 40
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
- 2021Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphonecited by 33
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 31
- 2024Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Modelscited by 31
38 more
- 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 28
- 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 22
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 21
- 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
- 2021Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractorscited by 15
- 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systemscited by 15
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2023One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognitioncited by 12
- 2024A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognitioncited by 12
- 2022Multi-scale Speaker Diarization with Dynamic Scale Weightingcited by 11
- 2023Adapting Multi-Lingual ASR Models for Handling Multiple Talkerscited by 11
- 2024Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognitioncited by 11
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
- 2024Advancing Multi-talker ASR Performance with Large Language Modelscited by 10
- 2021CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcriptioncited by 9
- 2024Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognitioncited by 9
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractorscited by 8
- 2022ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancementcited by 8
- 2024Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Modelscited by 8
- 2024LLM-based speaker diarization correction: A generalizable approachcited by 8
- 2025Hallucination Benchmark for Speech Foundation Modelscited by 8
- 2021Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordingscited by 7
- 2021USTC-NELSLIP System Description for DIHARD-III Challengecited by 7
- 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarizationcited by 7
- 2022VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognitioncited by 7
- 2025Efficient and Robust Speaker Diarization via Structured Pruning of Self-Supervised Modelscited by 7
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
- 2022A Conformer Based Acoustic Model for Robust Automatic Speech Recognitioncited by 6
- 2023STHG: Spatial-Temporal Heterogeneous Graph Learning for Advanced Audio-Visual Diarizationcited by 6
- 2024Neural Blind Source Separation and Diarization for Distant Speech Recognitioncited by 6
- 2024The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environmentscited by 6
- 2021DIVE: End-to-end Speech Diarization via Iterative Speaker Embeddingcited by 5
- 2022A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetingscited by 5
- 2023BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASRcited by 5
- 2023DiariST: Streaming Speech Translation with Speaker Diarizationcited by 5
- 2024Revisiting ASR Error Correction with Specialized Modelscited by 5
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognitioncited by 5
50 most cited of 132 All 132 (JSON)
- 2026PERSIST: Who-What-When Memory Across Sessions for Full-Duplex Spoken Dialogue6 Oct 2026
- 2026SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation3 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs30 Sep 2026
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026Asymmetric Classifier-Free Guidance for Target-Speaker ASR24 Sep 2026
- 2026Quieter Than the Room: Representation Drift and Task Robustness in Speech Encoders23 Sep 2026
- 2026Model-Agnostic and Language-Agnostic Voice Pipeline Improvement for the Agriculture Domain17 Sep 2026
- 2026Neural Multichannel Distant Speaker Diarization with Heavy-tailed Source Separation Model10 Sep 2026
- 2026No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus28 Aug 2026
- 2026When Robots Mishear Us: Mapping the Safety Risks of Voice-Controlled Embodied AI28 Aug 2026
- 2026Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO30 Jul 2026
38 more
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages26 Jul 2026
- 2026RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems16 Jul 2026
- 2026On the Role of Conversational Timing in Synthetic Training Data for ASR9 Jul 2026
- 2026PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction9 Jul 2026
- 2026Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors17 Jun 2026
- 2026Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings16 Jun 2026
- 2026Efficient ASR Training with Conversations that Never Happened2 Jun 2026
- 2026MURMUR: An Efficient Inference System for Long-Form ASR31 May 2026
- 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metrics24 Mar 2026
- 2026Mask2Flow-TSE: Two-Stage Target Speaker Extraction with Masking and Flow Matching13 Mar 2026
- 2026Iterative LLM-based improvement for French Clinical Interview Transcription and Speaker Diarization16 Feb 2026
- 2026Speaker-Aware Simulation Improves Conversational Speech Recognition4 Feb 2026
- 2026MeetBench-XL: Calibrated Multi-Dimensional Evaluation and Learned Dual-Policy Agents for Real-Time Meetings3 Feb 2026
- 2026CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASR30 Jan 2026
- 2026RIR-Mega-Speech: A Reverberant Speech Corpus with Comprehensive Acoustic Metadata and Reproducible Evaluation25 Jan 2026
- 2026TagSpeech: End-to-End Multi-Speaker ASR and Diarization with Fine-Grained Temporal Grounding11 Jan 2026
- 2025LibriConvo: Simulating Conversations from Read Literature for ASR and Diarization27 Oct 2025
- 2025A Cocktail-Party Benchmark: Multi-Modal dataset and Comparative Evaluation Results27 Oct 2025
- 2025M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Models22 Oct 2025
- 2025Hallucination Benchmark for Speech Foundation Models18 Oct 2025
- 2025Automatic Speech Recognition in the Modern Era: Architectures, Training, and Evaluation11 Oct 2025
- 2025Target speaker anonymization in multi-speaker recordings10 Oct 2025
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASR23 Sep 2025
- 2025Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder28 Aug 2025
- 2025SPGISpeech 2.0: Transcribed multi-speaker financial audio for speaker-tagged transcription7 Aug 2025
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching12 Jul 2025
- 2025The Impact of Automatic Speech Transcription on Speaker Attribution11 Jul 2025
- 2025Omni-Router: Sharing Routing Decisions in Sparse Mixture-of-Experts for Speech Recognition8 Jul 2025
- 2025Efficient and Robust Speaker Diarization via Structured Pruning of Self-Supervised Models23 Jun 2025
- 2025Exploring Speaker Diarization with Mixture of Experts17 Jun 2025
- 2025Speaker-Distinguishable CTC: Learning Speaker Distinction Using CTC for Multi-Talker Speech Recognition9 Jun 2025
- 2025ABHINAYA -- A System for Speech Emotion Recognition In Naturalistic Conditions Challenge23 May 2025
- 2025The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition20 May 2025
- 2025Survey of End-to-End Multi-Speaker Automatic Speech Recognition for Monaural Audio16 May 2025
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition30 Apr 2025
- 2025Adopting Whisper for Confidence Estimation19 Feb 2025
- 2025Playing with Voices: Tabletop Role-Playing Game Recordings as a Diarization Challenge18 Feb 2025
- 2025On the Robust Approximation of ASR Metrics18 Feb 2025
50 newest of 132 All 132 (JSON)
- 2026MURMUR: An Efficient Inference System for Long-Form ASRcited by 0
- 2026MURMUR: An Efficient Inference System for Long-Form ASR31 May 2026
- 2024Self-Train Before You Transcribecited by 0
- 2024Self-Train Before You Transcribe17 Jun 2024
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2021BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognitioncited by 88
- 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
- 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
- 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 62
- 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 40
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
- 2021Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphonecited by 33
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 31
- 2024Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Modelscited by 31
12 most cited of 122 All 122 (JSON)
- 2026PERSIST: Who-What-When Memory Across Sessions for Full-Duplex Spoken Dialogue6 Oct 2026
- 2026SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation3 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs30 Sep 2026
- 2026MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation29 Sep 2026
- 2026Asymmetric Classifier-Free Guidance for Target-Speaker ASR24 Sep 2026
- 2026Quieter Than the Room: Representation Drift and Task Robustness in Speech Encoders23 Sep 2026
- 2026Model-Agnostic and Language-Agnostic Voice Pipeline Improvement for the Agriculture Domain17 Sep 2026
- 2026Neural Multichannel Distant Speaker Diarization with Heavy-tailed Source Separation Model10 Sep 2026
- 2026When Robots Mishear Us: Mapping the Safety Risks of Voice-Controlled Embodied AI28 Aug 2026
- 2026Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO30 Jul 2026
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages26 Jul 2026
12 newest of 122 All 122 (JSON)