Polite on the Surface, Broken in Practice: A Curated Dataset for Fixing Generation and Register Failures in Low-Resource Bangla Text Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in Multilingual Large Language Models (MLLMs) have significantly enhanced cross-lingual conversational capabilities, yet modeling culturally nuanced and context-dependent communication remains a critical bottleneck. Specifically, existing state-of-the-art models exhibit a severe pragmatic gap when handling structural variations, regional idioms, and honorific consistencies in low-resource contexts like Bangla. To address this limitation, we introduce a novel, culturally aligned instruction-tuning dataset for BangLa Application and DialoguE generation - BLADE and benchmarking framework comprising 4,196 meticulously curated interaction pairs. We leverage this resource to systematically fine-tune and evaluate leading open-weight architectures, including DeepSeek-8B and LLaMA-3.2-3B, utilizing parameter-efficient fine-tuning via LoRA adapters in a 4-bit NormalFloat (NF4) quantization framework. Our empirical evaluations demonstrate that models fine-tuned on our dataset yield substantial improvements in structural fidelity and honorific alignment, providing a rigorous benchmark for bridging pragmatic disparities in low-resource multilingual text generation. Code and dataset: https://github.com/ashuvo25/BanglaApplicationLLM/tree/main
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
15 of 27 references.
References · 15
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 125
- 2024LLMs Are Few-Shot In-Context Low-Resource Language Learnerscited by 68
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 59
- 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
- 2022Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languagescited by 28
- 2024Quality or Quantity? On Data Scale and Diversity in Adapting Large Language Models for Low-Resource Translationcited by 13
- 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarkingcited by 9
- 2018Chittron: An Automatic Bangla Image Captioning Systemcited by 8
3 more
- 2025Do Language Models Understand Honorific Systems in Javanese?cited by 5
- 2025Women, Infamous, and Exotic Beings: A Comparative Study of Honorific Usages in Wikipedia and LLMs for Bengali and Hindicited by 2
- 2023Analyzing Syntactic Generalization Capacity of Pre-trained Language Models on Japanese Honorific Conversioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation
- 2026Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus
- 2026Understanding QA generation: Extracting Parametric and Contextual Knowledge with CQA for Low Resource Bangla Language
- 2026BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignment
- 2026BenSyc: Benchmarking Conversational Sycophancy and Human Alignment in LLMs for Bengali Contexts
- 2025Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
- 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact