mlsanityData to 14 Oct 2026

Semantic Grading of Written Answers in Low-Resource Language Bangla Using a Fine-Tuned Lightweight Language Model

arXiv 2606.11931 ↗First posted 10 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Bangla is among the world's most widely spoken languages, yet it remains underserved in educational NLP research. In many remote and rural regions, access to qualified subject teachers is limited, and written answers are consequently graded largely by hand, restricting timely and consistent feedback. Automatic assessment is challenging because semantically correct responses can vary substantially in surface form. We present a bilingual (Bangla-English) evaluation system designed for low-resource educational settings that prioritizes semantic correctness over lexical overlap. Our approach fine-tunes a lightweight language model to grade each response using the question, reference answer, and student answer, producing a numeric score and concise, context-grounded feedback suitable for classroom deployment. We also construct a synthetic bilingual dataset to enable controlled training and evaluation. Across proprietary and open-source LLMs evaluated under a unified protocol, our QLoRA-tuned Qwen3-8B confirms consistent improvement by producing the most leakage-resistant feedback (RoRa = 0.819) in synthetic evaluation and the strongest agreement with human scores (rho = 0.936, MAE = 0.725) in a dedicated human study.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

11 of 22 references.

References · 11

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  8. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
  9. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 177
  10. 2023ReCEval: Evaluating Reasoning Chains via Correctness and Informativenesscited by 77
  11. 2024RORA: Robust Free-Text Rationale Evaluationcited by 4

Built on by

Not cited yet.