mlsanityData to 14 Oct 2026

IndoSafety: Culturally Grounded Safety for LLMs in Indonesian Languages

arXiv 2506.02573 ↗First posted 3 Jun 2025cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

Although region-specific large language models (LLMs) are increasingly developed, their safety remains underexplored, particularly in culturally diverse settings like Indonesia, where sensitivity to local norms is essential and highly valued by the community. In this work, we present IndoSafety, the first high-quality, human-verified safety evaluation dataset tailored for the Indonesian context, covering five language varieties: formal and colloquial Indonesian, along with three major local languages: Javanese, Sundanese, and Minangkabau. IndoSafety is constructed by extending prior safety frameworks to develop a taxonomy that captures Indonesia's sociocultural context. We find that existing Indonesian-centric LLMs often generate unsafe outputs, particularly in colloquial and local language settings, while fine-tuning on IndoSafety significantly improves safety while preserving task performance. Our work highlights the critical need for culturally grounded safety evaluation and provides a concrete step toward responsible LLM deployment in multilingual settings. Warning: This paper contains example data that may be offensive, harmful, or biased.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 23 of its 44 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

23 of 44 references.

References · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  6. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  7. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  8. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  9. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
  10. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
  11. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  12. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingcited by 247
11 more
  1. 2022Are Large Pre-Trained Language Models Leaking Your Personal Information?cited by 200
  2. 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 192
  3. 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritizationcited by 170
  4. 2024Defending LLMs against Jailbreaking Attacks via Backtranslationcited by 70
  5. 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUcited by 53
  6. 2024Revisiting Jailbreaking for Large Language Models: A Representation Engineering Perspectivecited by 48
  7. 2022SafeText: A Benchmark for Exploring Physical Safety in Language Modelscited by 41
  8. 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 39
  9. 2023COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuancescited by 35
  10. 2024Arabic Dataset for LLM Safeguard Evaluationcited by 17
  11. 2024Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesiacited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.