Why Low-Resource NLP Needs More Than Cross-Lingual Transfer: Lessons Learned from Luxembourgish
Not on the map. Why?
Abstract (arXiv)
Cross-lingual transfer has become a central paradigm for extending natural language processing (NLP) technologies to low-resource languages. By leveraging supervision from high-resource languages, multilingual language models can achieve strong task performance with little or no labeled target-language data. However, it remains unclear to what extent cross-lingual transfer can substitute for language-specific efforts. In this paper, we synthesize prior research findings and data collection results on Luxembourgish, which, despite its typological proximity to high-resource languages and its presence in a multilingual context, remains insufficiently represented in modern NLP technologies. Across findings, we observe a fundamental interdependence between cross-lingual transfer and language-specific efforts. Cross-lingual transfer can substantially improve target-language performance, but its success depends critically on the availability of sufficiently high-quality, task-aligned target-language data. At the same time, such resources, particularly in low-resource settings, are typically too limited in scale to drive strong performance on their own. Instead, such resources reach their full potential only when leveraged within a cross-lingual framework. We therefore argue that cross-lingual transfer and language-specific efforts should not be viewed as competing alternatives. Instead, they function as complementary components of a sustainable low-resource NLP pipeline. Based on these insights, we provide practical guidelines for integrating and balancing cross-lingual transfer with language-specific development in sustainable low-resource NLP pipelines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
19 of 34 references.
References · 19
- 2020Language-agnostic BERT Sentence Embeddingcited by 627
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 243
- 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 223
- 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
- 2024Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilitiescited by 111
- 2023Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpacacited by 60
- 2023Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Reviewcited by 50
- 2024Probing the Emergence of Cross-lingual Alignment during LLM Trainingcited by 39
- 2024Understanding Cross-Lingual Alignment -- A Surveycited by 34
- 2022A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bankcited by 29
7 more
- 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructionscited by 18
- 2024Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scalecited by 15
- 2024Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corporacited by 13
- 2024MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructionscited by 12
- 2024LuxBank: The First Universal Dependency Treebank for Luxembourgishcited by 9
- 2024LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddingscited by 7
- 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 5
Built on by
Not cited yet.