Riazi-8B: An Urdu Large Language Model for Mathematical Reasoning
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Recent LLMs demonstrate strong mathematical reasoning capabilities, but existing gains rely heavily on English-centric training resources and benchmarks. As a result, reasoning performance degrades substantially in low-resource languages such as Urdu, where reasoning-oriented datasets and adapted models remain scarce. Urdu lacks both reasoning-oriented resources and models adapted for multi-step mathematical problem solving, limiting the applicability of recent progress to Urdu-speaking users. We address this gap through Riazi-8B, an Urdu mathematical reasoning model developed through a two-step adaptation process comprising continued pre-training on Urdu Wikipedia and supervised fine-tuning on Urdu Chain-of-Thought data derived from GSM8K. We evaluate Riazi-8B on MGSM-Urdu against existing Urdu instruction-tuned models. Our results show consistent improvements in answer correctness, reasoning quality, response completeness, and Urdu generation. Our findings demonstrate that combining Urdu language adaptation with reasoning-focused fine-tuning is an effective strategy for extending mathematical reasoning capabilities to low-resource languages.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 25 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
21 of 25 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Let's Verify Step by Stepcited by 3,598
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
8 more
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
- 2023Calibrating LLM-Based Evaluatorcited by 53
- 2024Benchmarking the Performance of Pre-trained LLMs across Urdu NLP Taskscited by 8
- 2025Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillationcited by 5
- 2018Urdu Word Segmentation using Conditional Random Fields (CRFs)cited by 4
- 2026Qalb: Largest State-of-the-Art Urdu Large Language Model for 230M Speakers with Systematic Continued Pre-trainingcited by 3
- 2026UrduBench: An Urdu Reasoning Benchmark using Contextually Ensembled Translations with Human-in-the-Loopcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Multilingual Mathematical Reasoning: Advancing Open-Source LLMs in Hindi and English
- 2025MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
- 2024LLM Reasoning Engine: Specialized Training for Enhanced Mathematical Reasoning
- 2025A Survey on Large Language Models for Mathematical Reasoning
- 2026MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluation
- 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
- 2026Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
- 2024Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems