LuxInstruct: A Cross-Lingual Instruction Tuning Dataset For Luxembourgish
Not on the map. Why?
Abstract (arXiv)
Instruction tuning has become a key technique for enhancing the performance of large language models, enabling them to better follow human prompts. However, low-resource languages such as Luxembourgish face severe limitations due to the lack of high-quality instruction datasets. Traditional reliance on machine translation often introduces semantic misalignment and cultural inaccuracies. In this work, we address these challenges by creating a cross-lingual instruction tuning dataset for Luxembourgish, without resorting to machine-generated translations into it. Instead, by leveraging aligned data from English, French, and German, we build a high-quality dataset that preserves linguistic and cultural nuances. We provide evidence that cross-lingual instruction tuning not only improves representational alignment across languages but also the model's generative capabilities in Luxembourgish. This highlights how cross-lingual data curation can avoid the common pitfalls of machine-translated data and directly benefit low-resource language development.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
18 of 31 references.
References · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2024Multilingual Instruction Tuning With Just a Pinch of Multilingualitycited by 71
- 2023LongForm: Effective Instruction Tuning with Reverse Instructionscited by 47
- 2024Probing the Emergence of Cross-lingual Alignment during LLM Trainingcited by 38
- 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformerscited by 18
- 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructionscited by 18
- 2024Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialectcited by 13
- 2024MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructionscited by 12
6 more
- 2024Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?cited by 10
- 2024CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignmentcited by 10
- 2024Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasetscited by 8
- 2024LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddingscited by 7
- 2024Text Generation Models for Luxembourgish with Limited Data: A Balanced Multilingual Strategycited by 7
- 2025Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakhcited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.