mlsanityData to 14 Oct 2026

Walia-LLM: Enhancing Amharic-LLaMA by Integrating Task-Specific and Generative Datasets

arXiv 2402.08015 ↗First posted 12 Feb 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have received a lot of attention in natural language processing (NLP) research because of their exceptional performance in understanding and generating human languages. However, low-resource languages are left behind due to the unavailability of resources. In this work, we focus on enhancing the LLaMA-2-Amharic model by integrating task-specific and generative datasets to improve language model performance for Amharic. We compile an Amharic instruction fine-tuning dataset and fine-tuned LLaMA-2-Amharic model. The fine-tuned model shows promising results in different NLP tasks. We open-source our dataset creation pipeline, instruction datasets, trained models, and evaluation outputs to promote language-specific studies on these models.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

23 of 38 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  10. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  11. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  12. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
11 more
  1. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  3. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
  4. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  5. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  6. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  7. 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 223
  8. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  9. 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
  10. 2023Fine-tuning Large Language Models for Adaptive Machine Translationcited by 21
  11. 2023Natural Language Processing in Ethiopian Languages: Current State, Challenges, and Opportunitiescited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 3.

8 papers.

  1. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 16
  2. 2024Adapting Chat Language Models Using Only Target Unlabeled Language Datacited by 6
  3. 2025Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updatescited by 4
  4. 2025Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrievalcited by 3
  5. 2026Afri-MCQA: Multimodal Cultural Question Answering for African Languagescited by 2
  6. 2026AfriNLLB: Efficient Translation Models for African Languagescited by 2
  7. 2025LuxInstruct: A Cross-Lingual Instruction Tuning Dataset For Luxembourgishcited by 1
  8. 2026AmharicStoryQA: A Multicultural Story Question Answering Benchmark in Amhariccited by 0