mlsanityData to 7 Oct 2026

LuxInstruct: A Cross-Lingual Instruction Tuning Dataset For Luxembourgish

arXiv 2510.07074 ↗First posted 8 Oct 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Instruction tuning has become a key technique for enhancing the performance of large language models, enabling them to better follow human prompts. However, low-resource languages such as Luxembourgish face severe limitations due to the lack of high-quality instruction datasets. Traditional reliance on machine translation often introduces semantic misalignment and cultural inaccuracies. In this work, we address these challenges by creating a cross-lingual instruction tuning dataset for Luxembourgish, without resorting to machine-generated translations into it. Instead, by leveraging aligned data from English, French, and German, we build a high-quality dataset that preserves linguistic and cultural nuances. We provide evidence that cross-lingual instruction tuning not only improves representational alignment across languages but also the model's generative capabilities in Luxembourgish. This highlights how cross-lingual data curation can avoid the common pitfalls of machine-translated data and directly benefit low-resource language development.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

18 of 31 references.

References · 18

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  5. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  6. 2024Multilingual Instruction Tuning With Just a Pinch of Multilingualitycited by 71
  7. 2023LongForm: Effective Instruction Tuning with Reverse Instructionscited by 47
  8. 2024Probing the Emergence of Cross-lingual Alignment during LLM Trainingcited by 38
  9. 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformerscited by 18
  10. 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructionscited by 18
  11. 2024Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialectcited by 13
  12. 2024MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructionscited by 12
6 more
  1. 2024Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?cited by 10
  2. 2024CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignmentcited by 10
  3. 2024Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasetscited by 8
  4. 2024LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddingscited by 7
  5. 2024Text Generation Models for Luxembourgish with Limited Data: A Balanced Multilingual Strategycited by 7
  6. 2025Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakhcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.