mlsanityData to 14 Oct 2026

SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Data

arXiv 2511.18411 ↗First posted 23 Nov 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Although the community has tackled the acquisition of high-quality Arabic pretraining data, we still lack large-scale, multi-turn Arabic datasets that include reasoning and tool calling. Naive translation can work at the pretraining scale, but post-training demands much higher quality, which requires a stricter approach to dataset curation. In this work, we introduce SmolKalam, a translation of Smoltalk2 that uses a multi-model ensemble translation pipeline, applies quality filtering, and examines effective translation techniques for traditional decoder-only models through ablations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

14 of 26 references.

References · 14

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  3. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  4. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  5. 2024Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningcited by 138
  6. 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 88
  7. 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
  8. 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
  9. 2025Reinforcement Learning from Human Feedbackcited by 58
  10. 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
  11. 2025Seed-X: Building Strong Multilingual Translation LLM with 7B Parameterscited by 21
  12. 2024CIDAR: Culturally Relevant Instruction Dataset For Arabiccited by 17
2 more
  1. 2025FinerWeb-10BT: Refining Web Data with LLM-Based Line-Level Filteringcited by 6
  2. 2025Hala Technical Report: Building Arabic-Centric Instruction & Translation Models at Scalecited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mind the Gap: A Review of Arabic Post-Training Datasets and Their Limitations
  2. 2026RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
  3. 2024Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis
  4. 2025Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM
  5. 2026State-of-the-Art Arabic Language Modeling with Sparse MoE Fine-Tuning and Chain-of-Thought Distillation
  6. 2025UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
  7. 2026LLM-to-Speech: A Synthetic Data Pipeline for Training Dialectal Text-to-Speech Models
  8. 2025Early-Exit and Instant Confidence Translation Quality Estimation