Model-Agnostic and Language-Agnostic Voice Pipeline Improvement for the Agriculture Domain
Not on the map. Why?
Abstract (arXiv)
FarmerChat is Digital Green's AI-powered agricultural advisory assistant for smallholder farmers, who access it in their own language through text, voice, or photographs. Voice is a critical channel for this population, yet field-recorded speech is challenging for general-purpose automatic speech recognition (ASR) because recordings frequently contain machinery noise, background media, competing speakers, and domain-specific agricultural vocabulary. These conditions disproportionately affect crop, pest, chemical, and quantity terms that carry the meaning of a farmer's query. We present a modular, model-agnostic pipeline for improving ASR quality in FarmerChat without fine-tuning or replacing the underlying ASR model. The pipeline combines gated audio enhancement, speaker diarization and target-speaker selection, ASR, domain-aware correction using a weighted agricultural lexicon, and a quality gate for detecting unreliable transcripts. Only the diarization stage is fine-tuned; all other stages use off-the-shelf models behind common interfaces. We evaluate the pipeline on human-annotated FarmerChat recordings in Hindi, Telugu, and Odia using word error rate (WER) and a domain-weighted error rate that gives greater importance to agricultural terminology. The largest improvements occur on multi-speaker recordings, where target-speaker selection prevents competing speech from entering the transcript. Across the full corpus, the pipeline reduces WER by 16-23% relative on three cloud ASR models and by 5% on an on-device model. On multi-speaker recordings, the reductions are 32-42% for the cloud models and 16% for the on-device model. All reported reductions are statistically significant. These results show that targeted preprocessing, speaker selection, and domain-aware post-processing can substantially improve agricultural speech transcription while preserving the underlying ASR model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 30 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
15 of 30 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2020CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordingscited by 132
- 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
- 2021Towards Building ASR Systems for the Next Billion Userscited by 47
- 2023DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancementcited by 25
- 2024ASR Error Correction using Large Language Modelscited by 24
- 2024Leveraging Self-Supervised Learning for Speaker Diarizationcited by 23
- 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systemscited by 15
- 2022Multi-scale Speaker Diarization with Dynamic Scale Weightingcited by 11
- 2023SPRING-INX: A Multilingual Indian Language Speech Corpus by SPRING Lab, IIT Madrascited by 11
Built on by
Not cited yet.