Make It Hard to Hear, Easy to Learn: Long-Form Bengali ASR and Speaker Diarization via Extreme Augmentation and Perfect Alignment
Not on the map. Why?
Abstract (arXiv)
Although Automatic Speech Recognition (ASR) in Bengali has seen significant progress, processing long-duration audio and performing robust speaker diarization remain critical research gaps. To address the severe scarcity of joint ASR and diarization resources for this language, we introduce Lipi-Ghor-882, a comprehensive 882-hour multi-speaker Bengali dataset. In this paper, detailing our submission to the DL Sprint 4.0 competition, we systematically evaluate various architectures and approaches for long-form Bengali speech. For ASR, we demonstrate that raw data scaling is ineffective; instead, targeted fine-tuning utilizing perfectly aligned annotations paired with synthetic acoustic degradation (noise and reverberation) emerges as the singular most effective approach. Conversely, for speaker diarization, we observed that global open-source state-of-the-art models (such as Diarizen) performed surprisingly poorly on this complex dataset. Extensive model retraining yielded negligible improvements; instead, strategic, heuristic post-processing of baseline model outputs proved to be the primary driver for increasing accuracy. Ultimately, this work outlines a highly optimized dual pipeline achieving a ~0.019 Real-Time Factor (RTF), establishing a practical, empirically backed benchmark for low-resource, long-form speech processing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 8 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
6 of 8 references.
References · 6
- 2024Leveraging Self-Supervised Learning for Speaker Diarizationcited by 21
- 2026Bengali-Loop: Community Benchmarks for Long-Form Bangla ASR and Speaker Diarizationcited by 7
- 2024Contextual Biasing to Improve Domain-specific Custom Vocabulary Audio Transcription without Explicit Fine-Tuning of Whisper Modelcited by 5
- 2023Pseudo-Labeling for Domain-Agnostic Bangla Automatic Speech Recognitioncited by 4
- 2025VBx for End-to-End Neural and Clustering-based Diarizationcited by 3
- 2025Benchmarking Diarization Modelscited by 1
Built on by
Not cited yet.