# Scaling Arabic Medical Chatbots Using Synthetic Data: Enhancing Generative AI with Synthetic Patient Records

arXiv: https://arxiv.org/abs/2509.10108 · HTML: https://mlsanity.com/paper/2509.10108/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs.
- Builds on 7 of its 25 references that are in the map.
- First posted on arXiv 12 Sep 2025.

## Placed in

- Synthetic data and self-improvement for LLMs / [Medical synthetic data and agents](https://mlsanity.com/synth/medical-synthetic-data-and-agents/)

## Builds on (most cited first, 7 of 7)

- [A Study of Generative Large Language Model for Medical Research and Healthcare](https://mlsanity.com/paper/2305.13523/) (2023)
- [Large language models in healthcare and medical domain: A review](https://mlsanity.com/paper/2401.06775/) (2023)
- [Machine Learning for Synthetic Data Generation: A Review](https://mlsanity.com/paper/2302.04062/) (2023)
- [LLM-SEM: A Sentiment-Based Student Engagement Metric Using LLMS for E-Learning Platforms](https://mlsanity.com/paper/2412.13765/) (2024)
- [RIRO: Reshaping Inputs, Refining Outputs Unlocking the Potential of Large Language Models in Data-Scarce Contexts](https://mlsanity.com/paper/2412.15254/) (2024)
- [LMRPA: Large Language Model-Driven Efficient Robotic Process Automation for OCR](https://mlsanity.com/paper/2412.18063/) (2024)
- [ERPA: Efficient RPA Model Integrating OCR and LLMs for Intelligent Document Processing](https://mlsanity.com/paper/2412.19840/) (2024)

## Built on by (most cited first, 1 of 1)

- [Severity-Aware Curriculum Learning with Multi-Model Response Selection for Medical Text Generation](https://mlsanity.com/paper/2606.05510/) (2026)

## Abstract (arXiv)

The development of medical chatbots in Arabic is significantly constrained by the scarcity of large-scale, high-quality annotated datasets. While prior efforts compiled a dataset of 20,000 Arabic patient-doctor interactions from social media to fine-tune large language models (LLMs), model scalability and generalization remained limited. In this study, we propose a scalable synthetic data augmentation strategy to expand the training corpus to 100,000 records. Using advanced generative AI systems ChatGPT-4o and Gemini 2.5 Pro we generated 80,000 contextually relevant and medically coherent synthetic question-answer pairs grounded in the structure of the original dataset. These synthetic samples were semantically filtered, manually validated, and integrated into the training pipeline. We fine-tuned five LLMs, including Mistral-7B and AraGPT2, and evaluated their performance using BERTScore metrics and expert-driven qualitative assessments. To further analyze the effectiveness of synthetic sources, we conducted an ablation study comparing ChatGPT-4o and Gemini-generated data independently. The results showed that ChatGPT-4o data consistently led to higher F1-scores and fewer hallucinations across all models. Overall, our findings demonstrate the viability of synthetic augmentation as a practical solution for enhancing domain-specific language models in-low resource medical NLP, paving the way for more inclusive, scalable, and accurate Arabic healthcare chatbot systems.