Back to School: Translation Using Grammar Books
Not on the map. Why?
Abstract (arXiv)
Machine translation systems for high resource languages perform exceptionally well and produce high quality translations. Unfortunately, the vast majority of languages are not considered high resource and lack the quantity of parallel sentences needed to train such systems. These under-represented languages are not without resources, however, and bilingual dictionaries and grammar books are available as linguistic reference material. With current large language models (LLMs) supporting near book-length contexts, we can begin to use the available material to ensure advancements are shared among all of the world's languages. In this paper, we demonstrate incorporating grammar books in the prompt of GPT-4 to improve machine translation and evaluate the performance on 16 topologically diverse low-resource languages, using a combination of reference material to show that the machine translation performance of LLMs can be improved using this method.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 7 of its 15 references that are in the map. First posted on arXiv 20 Oct 2024.
Builds on
7 of 15 references.
References · 7
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 118
- 2023A Benchmark for Learning to Translate a New Language from One Grammar Bookcited by 74
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2024Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptionscited by 12
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchucited by 12
- 2025Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Bookscited by 4
- 2025The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlangcited by 3
- 2026Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metricscited by 2
- 2026Speaking of Language: Reflections on Metalanguage Research in NLPcited by 1
- 2025Testing the Limits of Machine Translation from One Bookcited by 0
- 2026Rashid: A Cipher-Based Framework for Exploring In-Context Language Learningcited by 0
- 2026Efficient Low-Resource Language Adaptation via Multi-Source Dynamic Logit Fusioncited by 0
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translationcited by 0
- 2026A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Bookscited by 0
- 2026LLM Agents as Computational Typologistscited by 0
- 2026LLM Agents as Computational Typologists7 Sep 2026
- 2026A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books24 Jul 2026
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation4 Jun 2026
- 2026Efficient Low-Resource Language Adaptation via Multi-Source Dynamic Logit Fusion20 Apr 2026
- 2026Speaking of Language: Reflections on Metalanguage Research in NLP3 Apr 2026
- 2026Rashid: A Cipher-Based Framework for Exploring In-Context Language Learning23 Mar 2026
- 2026Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics19 Feb 2026
- 2025The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang30 Aug 2025
- 2025Testing the Limits of Machine Translation from One Book8 Aug 2025
- 2025Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books2 Jun 2025
- 2025Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu17 Feb 2025