mlsanityData to 7 Oct 2026

SEA-SafeguardBench: Evaluating AI Safety in SEA Languages and Cultures

arXiv 2512.05501 ↗First posted 5 Dec 2025cs.CLcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Safeguard models help large language models (LLMs) detect and block harmful content, but most evaluations remain English-centric and overlook linguistic and cultural diversity. Existing multilingual safety benchmarks often rely on machine-translated English data, which fails to capture nuances in low-resource languages. Southeast Asian (SEA) languages are underrepresented despite the region's linguistic diversity and unique safety concerns, from culturally sensitive political speech to region-specific misinformation. Addressing these gaps requires benchmarks that are natively authored to reflect local norms and harm scenarios. We introduce SEA-SafeguardBench, the first human-verified safety benchmark for SEA, covering eight languages, 21,640 samples, across three subsets: general, in-the-wild, and content generation. The experimental results from our benchmark demonstrate that even state-of-the-art LLMs and guardrails are challenged by SEA cultural and harm scenarios and underperform when compared to English texts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 23 of its 47 references that are in the map. First posted on arXiv 5 Dec 2025.

Builds on

23 of 47 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems11 Jul
  2. 2025MPO: Multilingual Safety Alignment via Reward Gap Optimization22 May
  3. 2025X-Guard: Multilingual Guard Agent for Content Moderation11 Apr
  4. 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrails15 Jan
  5. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs26 Jun

Other references · 18

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  4. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  5. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  6. 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 273
  7. 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 224
  8. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 126
  9. 2021Survey of Low-Resource Machine Translationcited by 92
  10. 2024SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languagescited by 41
  11. 2024WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisinescited by 39
  12. 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integrationcited by 22
6 more
  1. 2025SoK: Evaluating Jailbreak Guardrails for Large Language Modelscited by 17
  2. 2025Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchucited by 12
  3. 2024A Statistical Framework for Ranking LLM-Based Chatbotscited by 11
  4. 2024SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singaporecited by 10
  5. 2025LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderatorscited by 7
  6. 2024Low-resource Machine Translation: what for? who for? An observational study on a dedicated Tetun language translation servicecited by 5

Built on by

Not cited yet.