mlsanityData to 14 Oct 2026

Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM

arXiv 2503.14603 ↗First posted 18 Mar 2025cs.CL cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Building high-quality large language models (LLMs) for enterprise Arabic applications remains challenging due to the limited availability of digitized Arabic data. In this work, we present a data synthesis and refinement strategy to help address this problem, namely, by leveraging synthetic data generation and human-in-the-loop annotation to expand our Arabic training corpus. We further present our iterative post training recipe that is essential to achieving state-of-the-art performance in aligning the model with human preferences, a critical aspect to enterprise use cases. The culmination of this effort is the release of a small, 7B, open-weight model that outperforms similarly sized peers in head-to-head comparisons and on Arabic-focused benchmarks covering cultural knowledge, instruction following, RAG, and contextual faithfulness.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

31 of 51 references.

References · 31

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  7. 2023A Survey of Large Language Modelscited by 2,576
  8. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  9. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  10. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  11. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
  12. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
19 more
  1. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  2. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  3. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
  4. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
  5. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
  6. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  7. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  8. 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 88
  9. 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 86
  10. 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
  11. 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
  12. 2020EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answeringcited by 60
  13. 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
  14. 2019Neural Arabic Question Answeringcited by 48
  15. 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 35
  16. 2024ArabicaQA: A Comprehensive Dataset for Arabic Question Answeringcited by 20
  17. 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabiccited by 11
  18. 2024Alignment at Pre-training! Towards Native Alignment for Arabic LLMscited by 7
  19. 2024Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 13.

16 papers.

Sort:

By area:

  1. 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
  2. 2025FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Modelscited by 5
  3. 2025LAILA: A Large Trait-Based Dataset for Arabic Automated Essay Scoringcited by 3
  4. 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmarkcited by 3
  5. 2026Structuring the Space of Sociotechnical Alignmentcited by 2
  6. 2026Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMscited by 1
  7. 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
  8. 2026Think in English, Answer in Korean: Efficient Adaptation of Multilingual Tool-Using Agentscited by 1
  9. 2026OptiMer: Optimal Distribution Vector Merging Is Better than Data Mixing for Continual Pre-Trainingcited by 0
  10. 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selectioncited by 0
  11. 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialoguescited by 0
  12. 2026Redteaming Leading Arabic LLMs with ASAScited by 0
4 more
  1. 2026E-CONAN (Entailment, CONtradition And Neutral) Benchmarks: Arabic Textual Entailment and Natural Inference Datasetscited by 0
  2. 2026Evaluating Communicative Success in Machine-Translated Conversationcited by 0
  3. 2026E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understandingcited by 0
  4. 2026AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabiccited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations
  2. 2026RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
  3. 2025UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
  4. 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities
  5. 2026State-of-the-Art Arabic Language Modeling with Sparse MoE Fine-Tuning and Chain-of-Thought Distillation
  6. 2025Tool Calling for Arabic LLMs: Data Strategies and Instruction Tuning
  7. 2024CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks
  8. 2023Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models