A Comparative Analysis of Retrieval-Augmented Generation Techniques for Bengali Standard-to-Dialect Machine Translation Using LLMs
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Translating from a standard language to its regional dialects is a significant NLP challenge due to scarce data and linguistic variation, a problem prominent in the Bengali language. This paper proposes and compares two novel RAG pipelines for standard-to-dialectal Bengali translation. The first, a Transcript-Based Pipeline, uses large dialect sentence contexts from audio transcripts. The second, a more effective Standardized Sentence-Pairs Pipeline, utilizes structured localdialect:standardbengali sentence pairs. We evaluated both pipelines across six Bengali dialects and multiple LLMs using BLEU, ChrF, WER, and BERTScore. Our findings show that the sentence-pair pipeline consistently outperforms the transcript-based one, reducing Word Error Rate (WER) from 76% to 55% for the Chittagong dialect. Critically, this RAG approach enables smaller models (e.g., Llama-3.1-8B) to outperform much larger models (e.g., GPT-OSS-120B), demonstrating that a well-designed retrieval strategy can be more crucial than model size. This work contributes an effective, fine-tuning-free solution for low-resource dialect translation, offering a practical blueprint for preserving linguistic diversity.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 8 of its 20 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
8 of 20 references.
References · 8
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2023TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varietiescited by 16
- 2023L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERTcited by 15
- 2025Advancing Dialectal Arabic to Modern Standard Arabic Machine Translationcited by 6
- 2025Bridging Dialects: Translating Standard Bangla to Regional Variants Using Neural Modelscited by 3
- 2025RegSpeech12: A Regional Corpus of Bengali Spontaneous Speech Across Dialectscited by 2
- 2025Vuyko Mistral: Adapting LLMs for Low-Resource Dialectal Translationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Cost-Efficient Cross-Lingual Retrieval-Augmented Generation for Low-Resource Languages: A Case Study in Bengali Agricultural Advisorycited by 2
- 2026The Hrunting of AI: Where and How to Improve English Dialectal Fairnesscited by 0
- 2026Benchmarking Bengali Dialectal Bias: A Multi-Stage Framework Integrating RAG-Based Translation and Human-Augmented RLAIFcited by 0
- 2026Benchmarking Bengali Dialectal Bias: A Multi-Stage Framework Integrating RAG-Based Translation and Human-Augmented RLAIF22 Mar 2026
- 2026The Hrunting of AI: Where and How to Improve English Dialectal Fairness16 Mar 2026
- 2026Cost-Efficient Cross-Lingual Retrieval-Augmented Generation for Low-Resource Languages: A Case Study in Bengali Agricultural Advisory5 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMs
- 2026Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus
- 2025IndicRAGSuite: Large-Scale Datasets and a Benchmark for Indian Language RAG Systems
- 2024Retrieval-Augmented Machine Translation with Unstructured Knowledge
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language
- 2024LA-RAG:Enhancing LLM-based ASR Accuracy with Retrieval-Augmented Generation
- 2025BnMMLU: Measuring Massive Multitask Language Understanding in Bengali
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research