Arabic Safety Alignment as Selective Refusal: An Empirical Study of SFT, DPO, and Guard Calibration
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Arabic large language models must refuse harmful prompts without over-refusing benign or sensitive prompts, yet a single refusal rate hides this trade-off. We evaluate it using benign refusal B and harmful-prompt refusal H, where H measures refusal rather than harmful compliance. Across five Arabic-capable models and 130 runs on the full human-written AraSafe set, refusal-only supervised fine-tuning (SFT) collapses toward blanket refusal, whereas selected mixed-SFT configurations reach H = 90% to 93% at B = 14% to 23%; four selected configurations exceed the H = 90% target in all three runs, while Fanar does so in two of three. Direct Preference Optimization (DPO) and inference guards change B and H differently across models rather than acting as uniform upgrades. In a blinded 300-response audit, annotator binary-refusal agreement is 89.0% (kappa = 0.78); Qwen3Guard and Aya Expanse 32B reach 88.7% and 91.0% accuracy, respectively, with no conclusive paired difference. Selected SFT raises H on Arabizi for all five models, but none reaches 90%, showing only partial transfer from Modern Standard Arabic. Overall, the results support model-specific operating-point selection: set a deployment target and retain only interventions that improve it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 11 of its 18 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
11 of 18 references.
Closest ancestors · 2
Same direction, newest first
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset10 Jul
Other references · 9
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2024Programming Refusal with Conditional Activation Steeringcited by 206
- 2024Panacea: Pareto Alignment via Preference Adaptation for LLMscited by 80
- 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
- 2025Fanar: An Arabic-Centric Multimodal Generative AI Platformcited by 67
- 2024Arabic Dataset for LLM Safeguard Evaluationcited by 17
- 2025Hala Technical Report: Building Arabic-Centric Instruction & Translation Models at Scalecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SomaliBench Eval: Measuring English-to-Somali Refusal Gaps in Open-Weight Language Models
- 2026LSR: Linguistic Safety Robustness Benchmark for Low-Resource West African Languages
- 2026Multilingual Refusal Alignment for Safer Large Language Models
- 2025Refusal Direction is Universal Across Safety-Aligned Languages
- 2026LLMs Can Unlearn Refusal with Only 1,000 Benign Samples
- 2025From Threat to Tool: Leveraging Refusal-Aware Injection Attacks for Safety Alignment
- 2026RISA: Response Inspection and Selective Actions for Refusal Calibration in Large Language Models
- 2026Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety