mlsanityData to 14 Oct 2026

LiveSecBench: A Dynamic and Event-Driven Safety Benchmark for Chinese Language Model Applications

arXiv 2511.02366 ↗First posted 4 Nov 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce LiveSecBench, a continuously updated safety benchmark specifically for Chinese-language LLM application scenarios. LiveSecBench constructs a high-quality and unique dataset through a pipeline that combines automated generation with human verification. By periodically releasing new versions to expand the dataset and update evaluation metrics, LiveSecBench provides a robust and up-to-date standard for AI safety. In this report, we introduce our second release v251215, which evaluates across five dimensions (Public Safety, Fairness & Bias, Privacy, Truthfulness, and Mental Health Safety.) We evaluate 57 representative LLMs using an ELO rating system, offering a leaderboard of the current state of Chinese LLM safety. The result is available at https://livesecbench.intokentech.cn/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 9 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

6 of 9 references.

References · 6

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  3. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  4. 2022Red Teaming Language Models with Language Modelscited by 1,026
  5. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
  6. 2023CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibilitycited by 85

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models
  2. 2026CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns
  3. 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluation
  4. 2023Safety Assessment of Chinese Large Language Models
  5. 2026CHILLGuard: Towards Fine-Grained Chinese LLM Safety Guardrail with Scalable Data Construction and Model-aware Preference Alignment
  6. 2026Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese
  7. 2025JailBench: A Comprehensive Chinese Security Assessment Benchmark for Large Language Models
  8. 2025Policy-Grounded Safety Evaluation of 20 Large Language Models