CUTE: A Multilingual Dataset for Enhancing Cross-Lingual Knowledge Transfer in Low-Resource Languages
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) demonstrate exceptional zero-shot capabilities in various NLP tasks, significantly enhancing user experience and efficiency. However, this advantage is primarily limited to resource-rich languages. For the diverse array of low-resource languages, support remains inadequate, with the scarcity of training corpora considered the primary cause. We construct and open-source CUTE Chinese, Uyghur, Tibetan,English dataset, consisting of two 25GB sets of four-language corpora (one parallel and one non-parallel), obtained through machine translation. CUTE encompasses two resource-rich languages (Chinese and English) and two low-resource languages (Uyghur and Tibetan). Prior to constructing CUTE, human assessment validates that the machine translation quality between Chinese-Uyghur and Chinese-Tibetan approaches that of Chinese-English translation. CUTE represents the largest open-source corpus for Uyghur and Tibetan languages to date, and we demonstrate its effectiveness in enhancing LLMs' ability to process low-resource languages while investigating the role of corpus parallelism in cross-lingual transfer learning. The CUTE corpus and related models are made publicly available to the research community.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 21 Sep 2025.
Builds on
25 of 38 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2019Cross-lingual Language Model Pretrainingcited by 1,090
13 more
- 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 387
- 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
- 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 174
- 2022Towards a Cleaner Document-Oriented Multilingual Crawled Corpuscited by 143
- 2023Skywork: A More Open Bilingual Foundation Modelcited by 112
- 2022BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Promptingcited by 90
- 2018A Span-Extraction Dataset for Chinese Machine Reading Comprehensioncited by 84
- 2024LLMs Are Few-Shot In-Context Low-Resource Language Learnerscited by 68
- 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languagescited by 50
- 2024Teaching Large Language Models an Unseen Language on the Flycited by 30
- 2023InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuningcited by 21
- 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructionscited by 18
- 2024Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignmentcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.