mlsanityData to 7 Oct 2026

SafetyBench: Evaluating the Safety of Large Language Models

arXiv 2309.07045 ↗First posted 13 Sep 2023cs.CLcited by 189

Not on the map. Why?

Cited by 40 in LLM safety and security, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

With the rapid development of Large Language Models (LLMs), increasing attention has been paid to their safety concerns. Consequently, evaluating the safety of LLMs has become an essential task for facilitating the broad applications of LLMs. Nevertheless, the absence of comprehensive safety evaluation benchmarks poses a significant impediment to effectively assess and enhance the safety of LLMs. In this work, we present SafetyBench, a comprehensive benchmark for evaluating the safety of LLMs, which comprises 11,435 diverse multiple choice questions spanning across 7 distinct categories of safety concerns. Notably, SafetyBench also incorporates both Chinese and English data, facilitating the evaluation in both languages. Our extensive tests over 25 popular Chinese and English LLMs in both zero-shot and few-shot settings reveal a substantial performance advantage for GPT-4 over its counterparts, and there is still significant room for improving the safety of current LLMs. We also demonstrate that the measured safety understanding abilities in SafetyBench are correlated with safety generation abilities. Data and evaluation guidelines are available at urlhttps://github.com/thu-coai/SafetyBenchhttps://github.com/thu-coai/SafetyBench. Submission entrance and leaderboard are available at urlhttps://llmbench.ai/safetyhttps://llmbench.ai/safety.

Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 13 Sep 2023.

Builds on

29 of 36 references.

References · 29

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2022Emergent Abilities of Large Language Modelscited by 2,483
  5. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  6. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  7. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  8. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  9. 2021Ethical and social risks of harm from Language Modelscited by 957
  10. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  11. 2020Aligning AI With Shared Human Valuescited by 706
  12. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
17 more
  1. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  2. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  3. 2018Gender Bias in Coreference Resolutioncited by 438
  4. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  5. 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 320
  6. 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
  7. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  8. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 133
  9. 2020Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotescited by 100
  10. 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 92
  11. 2023Safety Assessment of Chinese Large Language Modelscited by 82
  12. 2023CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibilitycited by 80
  13. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  14. 2022SafeText: A Benchmark for Exploring Physical Safety in Language Modelscited by 41
  15. 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
  16. 2023Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confidence Estimationcited by 36
  17. 2023Measuring Massive Multitask Chinese Understandingcited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 49; 2025: 70; 2026: 63.

189 papers.

Sort:

By area:

  1. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  2. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  3. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  4. 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 284
  5. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
  6. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
  7. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 224
  8. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
  9. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  10. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  11. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  12. 2024Benchmarking LLMs via Uncertainty Quantificationcited by 124
38 more
  1. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 112
  2. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
  3. 2025Large Language Models Often Know When They Are Being Evaluatedcited by 105
  4. 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 100
  5. 2024Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documentscited by 93
  6. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  7. 2023Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agentscited by 72
  8. 2024Safety of Multimodal Large Language Models on Images and Textscited by 70
  9. 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
  10. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
  11. 2024Knowledge Circuits in Pretrained Transformerscited by 60
  12. 2024SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Typescited by 58
  13. 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?cited by 56
  14. 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 49
  15. 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluationcited by 46
  16. 2026SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Taskscited by 45
  17. 2024MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Modelscited by 43
  18. 2024Benchmarking Linguistic Diversity of Large Language Modelscited by 37
  19. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  20. 2024MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMscited by 32
  21. 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 32
  22. 2024From Theft to Bomb-Making: The Ripple Effect of Unlearning in Defending Against Jailbreak Attackscited by 29
  23. 2024Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementationcited by 27
  24. 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 26
  25. 2025CARES: Comprehensive Evaluation of Safety and Adversarial Robustness in Medical LLMscited by 26
  26. 2025o3-mini vs DeepSeek-R1: Which One is Safer?cited by 24
  27. 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24
  28. 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
  29. 2025SafeDialBench: A Fine-Grained Safety Evaluation Benchmark for Large Language Models in Multi-Turn Dialogues with Diverse Jailbreak Attackscited by 23
  30. 2025SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraintscited by 21
  31. 2025From Passive to Active Reasoning: Can Large Language Models Ask the Right Questions under Incomplete Information?cited by 21
  32. 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 20
  33. 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?cited by 20
  34. 2025Human Decision-making is Susceptible to AI-driven Manipulationcited by 19
  35. 2025Are Smarter LLMs Safer? Exploring Safety-Reasoning Trade-offs in Prompting and Fine-Tuningcited by 19
  36. 2024Causal Evaluation of Language Modelscited by 18
  37. 2024Large Action Models: From Inception to Implementationcited by 18
  38. 2023SC-Safety: A Multi-round Open-ended Question Adversarial Safety Benchmark for Large Language Models in Chinesecited by 17

50 most cited of 189 All 189 (JSON)