mlsanityData to 7 Oct 2026

Make It Hard to Hear, Easy to Learn: Long-Form Bengali ASR and Speaker Diarization via Extreme Augmentation and Perfect Alignment

arXiv 2602.23070 ↗First posted 26 Feb 2026cs.SD cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Although Automatic Speech Recognition (ASR) in Bengali has seen significant progress, processing long-duration audio and performing robust speaker diarization remain critical research gaps. To address the severe scarcity of joint ASR and diarization resources for this language, we introduce Lipi-Ghor-882, a comprehensive 882-hour multi-speaker Bengali dataset. In this paper, detailing our submission to the DL Sprint 4.0 competition, we systematically evaluate various architectures and approaches for long-form Bengali speech. For ASR, we demonstrate that raw data scaling is ineffective; instead, targeted fine-tuning utilizing perfectly aligned annotations paired with synthetic acoustic degradation (noise and reverberation) emerges as the singular most effective approach. Conversely, for speaker diarization, we observed that global open-source state-of-the-art models (such as Diarizen) performed surprisingly poorly on this complex dataset. Extensive model retraining yielded negligible improvements; instead, strategic, heuristic post-processing of baseline model outputs proved to be the primary driver for increasing accuracy. Ultimately, this work outlines a highly optimized dual pipeline achieving a ~0.019 Real-Time Factor (RTF), establishing a practical, empirically backed benchmark for low-resource, long-form speech processing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 8 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

6 of 8 references.

References · 6

  1. 2024Leveraging Self-Supervised Learning for Speaker Diarizationcited by 21
  2. 2026Bengali-Loop: Community Benchmarks for Long-Form Bangla ASR and Speaker Diarizationcited by 7
  3. 2024Contextual Biasing to Improve Domain-specific Custom Vocabulary Audio Transcription without Explicit Fine-Tuning of Whisper Modelcited by 5
  4. 2023Pseudo-Labeling for Domain-Agnostic Bangla Automatic Speech Recognitioncited by 4
  5. 2025VBx for End-to-End Neural and Clustering-based Diarizationcited by 3
  6. 2025Benchmarking Diarization Modelscited by 1

Built on by

Not cited yet.