NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription
Not on the map. Why?
Abstract (arXiv)
We introduce the first Natural Office Talkers in Settings of Far-field Audio Recordings (``NOTSOFAR-1'') Challenge alongside datasets and baseline system. The challenge focuses on distant speaker diarization and automatic speech recognition (DASR) in far-field meeting scenarios, with single-channel and known-geometry multi-channel tracks, and serves as a launch platform for two new datasets: First, a benchmarking dataset of 315 meetings, averaging 6 minutes each, capturing a broad spectrum of real-world acoustic conditions and conversational dynamics. It is recorded across 30 conference rooms, featuring 4-8 attendees and a total of 35 unique speakers. Second, a 1000-hour simulated training dataset, synthesized with enhanced authenticity for real-world generalization, incorporating 15,000 real acoustic transfer functions. The tasks focus on single-device DASR, where multi-channel devices always share the same known geometry. This is aligned with common setups in actual conference rooms, and avoids technical complexities associated with multi-device tasks. It also allows for the development of geometry-specific solutions. The NOTSOFAR-1 Challenge aims to advance research in the field of distant conversational speech recognition, providing key resources to unlock the potential of data-driven methods, which we believe are currently constrained by the absence of comprehensive high-quality training and benchmarking datasets.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 16 Jan 2024.
Builds on
20 of 41 references.
References · 20
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 230
- 2020CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordingscited by 129
- 2020The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Resultscited by 128
- 2018The fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, task and baselinescited by 90
- 2020Continuous speech separation: dataset and analysiscited by 73
- 2021M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challengecited by 67
- 2020Continuous Speech Separation with Conformercited by 36
- 2020Auto-Tuning Spectral Clustering for Speaker Diarization Using Normalized Maximum Eigengapcited by 35
- 2020Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysiscited by 34
8 more
- 2018Voices Obscured in Complex Environmental Settings (VOICES) corpuscited by 28
- 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 28
- 2019Advances in Online Audio-Visual Meeting Transcriptioncited by 23
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 20
- 2019DiPCo -- Dinner Party Corpuscited by 18
- 2023The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyondcited by 15
- 2022Multi-scale Speaker Diarization with Dynamic Scale Weightingcited by 11
- 2019Estimating & Mitigating the Impact of Acoustic Environments on Machine-to-Machine Signallingcited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 10.
18 papers.
Sort:
By area:
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialoguecited by 4
- 2024Mamba-based Segmentation Model for Speaker Diarizationcited by 3
- 2025SDBench: A Comprehensive Benchmark Suite for Speaker Diarizationcited by 3
- 2025Summary of the NOTSOFAR-1 Challenge: Highlights and Learningscited by 2
- 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challengescited by 2
- 2025Adapting Diarization-Conditioned Whisper for End-to-End Multi-Talker Speech Recognitioncited by 2
- 2026SE-DiCoW: Self-Enrolled Diarization-Conditioned Whispercited by 2
- 2024ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetingscited by 1
- 2025Talking to Robots: A Practical Examination of Speech Foundation Models for HRI Applicationscited by 1
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASRcited by 1
- 2026Adaptive Turn-Taking for Real-time Multi-Party Voice Agentscited by 1
- 2026CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASRcited by 0
6 more
- 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metricscited by 0
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognitioncited by 0
- 2026Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetingscited by 0
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languagescited by 0
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challengecited by 0
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetingscited by 0
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue25 Aug 2026
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages26 Jul 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings16 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026Adaptive Turn-Taking for Real-time Multi-Party Voice Agents11 Jun 2026
- 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metrics24 Mar 2026
- 2026CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASR30 Jan 2026
- 2026SE-DiCoW: Self-Enrolled Diarization-Conditioned Whisper27 Jan 2026
- 2025Adapting Diarization-Conditioned Whisper for End-to-End Multi-Talker Speech Recognition4 Oct 2025
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASR23 Sep 2025
6 more
- 2025Talking to Robots: A Practical Examination of Speech Foundation Models for HRI Applications25 Aug 2025
- 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challenges24 Jul 2025
- 2025SDBench: A Comprehensive Benchmark Suite for Speaker Diarization22 Jul 2025
- 2025Summary of the NOTSOFAR-1 Challenge: Highlights and Learnings28 Jan 2025
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct 2024
- 2024ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetings5 Jun 2024
- 2026Adaptive Turn-Taking for Real-time Multi-Party Voice Agents11 Jun 2026
- 2024Mamba-based Segmentation Model for Speaker Diarizationcited by 3
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct 2024
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialoguecited by 4
- 2025SDBench: A Comprehensive Benchmark Suite for Speaker Diarizationcited by 3
- 2025Summary of the NOTSOFAR-1 Challenge: Highlights and Learningscited by 2
- 2025Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challengescited by 2
- 2025Adapting Diarization-Conditioned Whisper for End-to-End Multi-Talker Speech Recognitioncited by 2
- 2026SE-DiCoW: Self-Enrolled Diarization-Conditioned Whispercited by 2
- 2024ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetingscited by 1
- 2025Talking to Robots: A Practical Examination of Speech Foundation Models for HRI Applicationscited by 1
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASRcited by 1
- 2026CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASRcited by 0
- 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metricscited by 0
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognitioncited by 0
12 most cited of 16 All 16 (JSON)
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue25 Aug 2026
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages26 Jul 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings16 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metrics24 Mar 2026
- 2026CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASR30 Jan 2026
- 2026SE-DiCoW: Self-Enrolled Diarization-Conditioned Whisper27 Jan 2026
- 2025Adapting Diarization-Conditioned Whisper for End-to-End Multi-Talker Speech Recognition4 Oct 2025
- 2025LOTUSDIS: A Thai far-field meeting corpus for robust conversational ASR23 Sep 2025
- 2025Talking to Robots: A Practical Examination of Speech Foundation Models for HRI Applications25 Aug 2025
12 newest of 16 All 16 (JSON)