Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM
Not on the map. Why?
Abstract (arXiv)
Building high-quality large language models (LLMs) for enterprise Arabic applications remains challenging due to the limited availability of digitized Arabic data. In this work, we present a data synthesis and refinement strategy to help address this problem, namely, by leveraging synthetic data generation and human-in-the-loop annotation to expand our Arabic training corpus. We further present our iterative post training recipe that is essential to achieving state-of-the-art performance in aligning the model with human preferences, a critical aspect to enterprise use cases. The culmination of this effort is the release of a small, 7B, open-weight model that outperforms similarly sized peers in head-to-head comparisons and on Arabic-focused benchmarks covering cultural knowledge, instruction following, RAG, and contextual faithfulness.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
31 of 51 references.
References · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
19 more
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
- 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
- 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
- 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 88
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 86
- 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
- 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
- 2020EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answeringcited by 60
- 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
- 2019Neural Arabic Question Answeringcited by 48
- 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 35
- 2024ArabicaQA: A Comprehensive Dataset for Arabic Question Answeringcited by 20
- 2024AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabiccited by 11
- 2024Alignment at Pre-training! Towards Native Alignment for Arabic LLMscited by 7
- 2024Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansioncited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 13.
16 papers.
Sort:
By area:
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
- 2025FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Modelscited by 5
- 2025LAILA: A Large Trait-Based Dataset for Arabic Automated Essay Scoringcited by 3
- 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmarkcited by 3
- 2026Structuring the Space of Sociotechnical Alignmentcited by 2
- 2026Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMscited by 1
- 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
- 2026Think in English, Answer in Korean: Efficient Adaptation of Multilingual Tool-Using Agentscited by 1
- 2026OptiMer: Optimal Distribution Vector Merging Is Better than Data Mixing for Continual Pre-Trainingcited by 0
- 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selectioncited by 0
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialoguescited by 0
- 2026Redteaming Leading Arabic LLMs with ASAScited by 0
4 more
- 2026E-CONAN (Entailment, CONtradition And Neutral) Benchmarks: Arabic Textual Entailment and Natural Inference Datasetscited by 0
- 2026Evaluating Communicative Success in Machine-Translated Conversationcited by 0
- 2026E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understandingcited by 0
- 2026AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabiccited by 0
- 2026AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabic28 Sep 2026
- 2026E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understanding27 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026E-CONAN (Entailment, CONtradition And Neutral) Benchmarks: Arabic Textual Entailment and Natural Inference Datasets10 Sep 2026
- 2026Redteaming Leading Arabic LLMs with ASAS22 Aug 2026
- 2026Think in English, Answer in Korean: Efficient Adaptation of Multilingual Tool-Using Agents30 Jun 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues30 Apr 2026
- 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selection7 Apr 2026
- 2026OptiMer: Optimal Distribution Vector Merging Is Better than Data Mixing for Continual Pre-Training30 Mar 2026
- 2026Buy versus Build an LLM: A Decision Framework for Governments13 Feb 2026
- 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark2 Feb 2026
4 more
- 2026Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMs19 Jan 2026
- 2025LAILA: A Large Trait-Based Dataset for Arabic Automated Essay Scoring30 Dec 2025
- 2025FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Models24 Nov 2025
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Models31 Oct 2025
- 2026Redteaming Leading Arabic LLMs with ASAScited by 0
- 2026Redteaming Leading Arabic LLMs with ASAS22 Aug 2026
- 2025DialectalArabicMMLU: Benchmarking Dialectal Capabilities in Arabic and Multilingual Language Modelscited by 6
- 2025FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Modelscited by 5
- 2025LAILA: A Large Trait-Based Dataset for Arabic Automated Essay Scoringcited by 3
- 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmarkcited by 3
- 2026Structuring the Space of Sociotechnical Alignmentcited by 2
- 2026Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMscited by 1
- 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
- 2026OptiMer: Optimal Distribution Vector Merging Is Better than Data Mixing for Continual Pre-Trainingcited by 0
- 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selectioncited by 0
- 2026E-CONAN (Entailment, CONtradition And Neutral) Benchmarks: Arabic Textual Entailment and Natural Inference Datasetscited by 0
- 2026Evaluating Communicative Success in Machine-Translated Conversationcited by 0
- 2026E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understandingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabic28 Sep 2026
- 2026E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understanding27 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026E-CONAN (Entailment, CONtradition And Neutral) Benchmarks: Arabic Textual Entailment and Natural Inference Datasets10 Sep 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selection7 Apr 2026
- 2026OptiMer: Optimal Distribution Vector Merging Is Better than Data Mixing for Continual Pre-Training30 Mar 2026
- 2026Buy versus Build an LLM: A Decision Framework for Governments13 Feb 2026
- 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark2 Feb 2026
- 2026Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMs19 Jan 2026
- 2025LAILA: A Large Trait-Based Dataset for Arabic Automated Essay Scoring30 Dec 2025
- 2025FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Models24 Nov 2025
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations
- 2026RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
- 2025UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
- 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities
- 2026State-of-the-Art Arabic Language Modeling with Sparse MoE Fine-Tuning and Chain-of-Thought Distillation
- 2025Tool Calling for Arabic LLMs: Data Strategies and Instruction Tuning
- 2024CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks
- 2023Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models