mlsanityData to 14 Oct 2026

From a Multilingual Streaming ASR Backbone to Kenyan-Language Systems: Data-Centric Adaptation of Nemotron 3.5 for Kikuyu, Dholuo, and Kalenjin

arXiv 2607.18912 ↗First posted 21 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Automatic speech recognition (ASR) for African languages is constrained by orthographic inconsistency, annotation artifacts, missing audio, speaker and domain imbalance, and evaluation procedures that differ from deployment. We present an end-to-end engineering study adapting NVIDIA Nemotron 3.5 ASR Streaming 0.6B to Kikuyu, Dholuo, and Kalenjin. Starting from a Kenyan Swahili-adapted checkpoint, we retain its cache-aware FastConformer RNN-T, prompt conditioning, and streaming decoder during full-parameter fine-tuning. The study covers corpus auditing, Unicode normalization, split checks, duration filtering, low-rate continuation, validation-based checkpoint selection, true-streaming evaluation, artifact preservation, and isolated serving. On internal, adaptively consulted evaluation sets excluded from gradient updates at context [56,13], selected Kikuyu and Dholuo models achieve 42.97% and 33.98% WER, respectively. Dholuo records 9.59% CER and 8.13% no-space CER under its frozen historical label policy; Kikuyu records 7.79% no-space CER. Kalenjin remains a work in progress: v1-v reaches 68.74% WER on a 2,411-row clean-v3 diagnostic subset excluding long-pause annotations, digit-bearing references, and targets shorter than three tokens. Its checkpoint selection used a mixed-source validation manifest containing test-origin rows, so the score is not an independent generalization estimate. We also report negative findings involving non-speech labels, short-utterance over-generation, boundary-sensitive WER, and cloud job-lifecycle failures. We make no state-of-the-art claim because the internal sets, repeated consultation, and normalization differ from public benchmarks. This work provides an auditable account of adapting a multilingual streaming model into language-specific systems without discarding streaming constraints.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 18 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

6 of 18 references.

References · 6

  1. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
  2. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 124
  3. 2020FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularizationcited by 69
  4. 2023Stateful Conformer with Cache-based Inference for Streaming Automatic Speech Recognitioncited by 25
  5. 2022Large vocabulary speech recognition for languages of Africa: multilingual modeling and self-supervised learningcited by 6
  6. 2026AfriVoices-KE: A Multilingual Speech Dataset for Kenyan Languagescited by 1

Built on by

Not cited yet.