mlsanityData to 14 Oct 2026

TRACE-BN: Transferring Bangla-English Tutoring Behavior to a Sub-1B Offline Language Model

arXiv 2608.15223 ↗First posted 15 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Bangla-English tutoring requires more than producing a correct translation: learners also need explanations of grammar differences, awareness of their likely errors, and targeted practice. We present TRACE-BN, a curriculum-guided dataset of structured tutoring traces for Bangla-speaking learners of English at the CEFR A1-A2 level. Each trace combines word-level glosses, literal and natural translations, Bangla grammar explanations, a plausible learner error, and a targeted practice question with its answer. The traces are generated by Gemini 3.5 Flash Lite as the teacher model from NCTB Classes 9-10 English curriculum units, then filtered for structural validity, script integrity, and semantic duplication. We transfer the resulting structured tutoring behavior to Qwen3-0.6B using LoRA with 4-bit quantization for resource-constrained offline deployment. On held-out inputs, schema validity increases from 85.4% to 95.8%, while, against teacher-model references, chrF++ improves from 15.28 to 34.77 and BLEU from 4.52 to 21.03. Field-level evaluation by two independent judges shows improvements across translation, grammar explanation, learner-error diagnosis, and practice alignment, while a human audit supports the quality of the supervision data. The results show that curriculum-guided structured supervision can transfer multi-component tutoring behavior to a sub-1B model under these resource constraints. The dataset, model checkpoints, and code are publicly available at https://huggingface.co/datasets/RaiyanKhaan/Trace-BN

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

14 of 27 references.

References · 14

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2025Learning to Generate Structured Output with Schema Reinforcement Learningcited by 29
  5. 2025StructEval: Benchmarking LLMs' Capabilities to Generate Structural Outputscited by 25
  6. 2025TigerLLM - A Family of Bangla Large Language Modelscited by 16
  7. 2025DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Modelscited by 10
  8. 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarkingcited by 9
  9. 2024Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMscited by 7
  10. 2024PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-trainingcited by 7
  11. 2024KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillationcited by 6
  12. 2024BanglaLlama: LLaMA for Bangla Languagecited by 5
2 more
  1. 2025LoRA-Gen: Specializing Large Language Model via Online LoRA Generationcited by 5
  2. 2026AFRILANGTUTOR: Advancing Language Tutoring and Culture Education in Low-Resource Languages with Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions
  2. 2025HSKBenchmark: Modeling and Benchmarking Chinese Second Language Acquisition in Large Language Models through Curriculum Tuning
  3. 2022Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding
  4. 2025BnMMLU: Measuring Massive Multitask Language Understanding in Bengali
  5. 2023CITING: Large Language Models Create Curriculum for Instruction Tuning
  6. 2025Toward Automated Qualitative Analysis: Leveraging Large Language Models for Tutoring Dialogue Evaluation
  7. 2025Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
  8. 2026Understanding Knowledge Distillation in Post-Training: When It Helps and When It Fails