Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages
Not on the map. Why?
Abstract (arXiv)
This paper introduces Chain of Translation Prompting (CoTR), a novel strategy designed to enhance the performance of language models in low-resource languages. CoTR restructures prompts to first translate the input context from a low-resource language into a higher-resource language, such as English. The specified task like generation, classification, or any other NLP function is then performed on the translated text, with the option to translate the output back to the original language if needed. All these steps are specified in a single prompt. We demonstrate the effectiveness of this method through a case study on the low-resource Indic language Marathi. The CoTR strategy is applied to various tasks, including sentiment analysis, hate speech classification, subject classification and text generation, and its efficacy is showcased by comparing it with regular prompting methods. Our results underscore the potential of translation-based prompting strategies to significantly improve multilingual LLM performance in low-resource languages, offering valuable insights for future research and applications. We specifically see the highest accuracy improvements with the hate speech detection task. The technique also has the potential to enhance the quality of synthetic data generation for underrepresented languages using LLMs.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 6 Sep 2024.
Builds on
30 of 46 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
18 more
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
- 2022Can language models learn from explanations in context?cited by 248
- 2021How Many Data Points is a Prompt Worth?cited by 197
- 2020A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarioscited by 170
- 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 103
- 2021Few-Shot Self-Rationalization with Natural Language Promptscited by 83
- 2017Learning with Latent Languagecited by 75
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2022L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resourcescited by 49
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2023Revisiting Machine Translation for Cross-lingual Classificationcited by 40
- 2021MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solverscited by 39
- 2022L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Librarycited by 30
- 2021L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Datasetcited by 28
- 2022L3Cube-MahaHate: A Tweet-based Marathi Hate Speech Detection Dataset and BERT modelscited by 20
- 2024L3Cube-IndicNews: News-based Short Text and Long Document Classification Datasets in Indic Languagescited by 8
- 2023L3Cube-MahaSent-MD: A Multi-domain Marathi Sentiment Analysis Dataset and Transformer Modelscited by 6
- 2024L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathicited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoningcited by 2
- 2026No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMscited by 1
- 2025VNJPTranslate: A comprehensive pipeline for Vietnamese-Japanese translationcited by 0
- 2025Leveraging the Potential of Prompt Engineering for Hate Speech Detection in Low-Resource Languagescited by 0
- 2026The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inferencecited by 0
- 2026The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference20 Jun 2026
- 2026No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs18 Apr 2026
- 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning9 Sep 2025
- 2025Leveraging the Potential of Prompt Engineering for Hate Speech Detection in Low-Resource Languages30 Jun 2025
- 2025VNJPTranslate: A comprehensive pipeline for Vietnamese-Japanese translation1 Apr 2025