Reference-Grounded Data Curation for Instruction-Following Thai-English Machine Translation
Not on the map. Why?
Abstract (arXiv)
Instruction-following machine translation (IF-MT) requires respecting prompt-level rules on terminology, formatting, and register. Rule compliance typically trades off against translation quality, a tension that general-purpose IF data augmentation methods do not address. We propose Reference-Grounded Data Curation, a two-phase pipeline that extracts every supervised constraint from a reference translation that already satisfies it, ensuring feasibility by construction. Phase 1 applies Instruction-Following Difficulty (IFD) scoring to retain the hardest-but-learnable instances from an English-Thai parallel pool. Phase 2 extracts constraints from each reference target and keeps only generations satisfying every constraint, yielding the 1.97M-record Grounded dataset. We fine-tune open-weight bases on Grounded to produce ChindaMT, a Thai-English translation family at 4B, 2B, and 0.8B parameters. Under length-controlled pairwise judging, ChindaMT outperforms or matches every same-size baseline at every tier on both plain translation and under explicit rules, reaching up to a 68.4% win rate against the strongest baseline. The recipe transfers cleanly across Qwen generations. We release model weights, the Grounded dataset, and evaluation suites.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
27 of 64 references.
References · 27
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2023Large Language Models are not Fair Evaluatorscited by 1,085
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364
15 more
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 307
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 146
- 2024Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningcited by 138
- 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 128
- 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 93
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 59
- 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
- 2025Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Studycited by 38
- 2024SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languagescited by 36
- 2021XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignmentcited by 15
- 2020scb-mt-en-th-2020: A Large English-Thai Parallel Corpuscited by 10
- 2026Scaling Model and Data for Multilingual Machine Translation with Open Large Language Modelscited by 4
Built on by
Not cited yet.