ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI
Not on the map. Why?
Abstract (arXiv)
Rapidly evolving AI exhibits increasingly strong autonomy and goal-directed capabilities, accompanied by derivative systemic risks that are more unpredictable, difficult to control, and potentially irreversible. However, current AI safety evaluation systems suffer from critical limitations such as restricted risk dimensions and failed frontier risk detection. The lagging safety benchmarks and alignment technologies can hardly address the complex challenges posed by cutting-edge AI models. To bridge this gap, we propose the "ForesightSafety Bench" AI Safety Evaluation Framework, beginning with 7 major Fundamental Safety pillars and progressively extends to advanced Embodied AI Safety, AI4Science Safety, Social and Environmental AI risks, Catastrophic and Existential Risks, as well as 8 critical industrial safety domains, forming a total of 94 refined risk dimensions. To date, the benchmark has accumulated tens of thousands of structured risk data points and assessment results, establishing a widely encompassing, hierarchically clear, and dynamically evolving AI safety evaluation framework. Based on this benchmark, we conduct systematic evaluation and in-depth analysis of over twenty mainstream advanced large models, identifying key risk patterns and their capability boundaries. The safety capability evaluation results reveals the widespread safety vulnerabilities of frontier AI across multiple pillars, particularly focusing on Risky Agentic Autonomy, AI4Science Safety, Embodied AI Safety, Social AI Safety and Catastrophic and Existential Risks. Our benchmark is released at https://github.com/Beijing-AISI/ForesightSafety-Bench. The project website is available at https://foresightsafety-bench.beijing-aisi.ac.cn/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 58 of its 92 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
58 of 92 references.
References · 58
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023A Survey of Large Language Modelscited by 2,576
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
38 more
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 451
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
- 2024A StrongREJECT for Empty Jailbreakscited by 385
- 2024Alignment faking in large language modelscited by 360
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 306
- 2024SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Modelscited by 228
- 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 129
- 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agentscited by 116
- 2017AI Safety Gridworldscited by 110
- 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 98
- 2024ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teamingcited by 98
- 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 74
- 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
- 2025ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Casescited by 65
- 2024Multimodal Situational Safetycited by 58
- 2024Risks of AI Scientists: Prioritizing Safeguarding Over Autonomycited by 49
- 2025IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Taskscited by 41
- 2023chatClimate: Grounding Conversational AI in Climate Sciencecited by 32
- 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agentscited by 30
- 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 29
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
- 2024EARBench: Towards Evaluating Physical Risk Awareness for Task Planning of Foundation Model-based Embodied AI Agentscited by 27
- 2024LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labscited by 25
- 2025FORTRESS: Frontier Risk Evaluation for National Security and Public Safetycited by 24
- 2023Assessing Large Language Models on Climate Informationcited by 23
- 2024Prompt Leakage effect and defense strategies for multi-turn LLM interactionscited by 23
- 2025RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agentscited by 15
- 2024Towards Safety and Helpfulness Balanced Responses via Controllable Large Language Modelscited by 14
- 2025SCAM: A Real-World Typographic Robustness Evaluation for Multimodal Foundation Modelscited by 13
- 2025Advancing Embodied Agent Security: From Safety Benchmarks to Input Moderationcited by 13
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Management
- 2025Safety by Measurement: A Systematic Literature Review of AI Safety Evaluation Methods
- 2026Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents
- 2026Astra: AI Safety, Trust, & Risk Assessment ↗
- 2026Evaluating Human-AI Safety: A Framework for Measuring Harmful Capability Uplift
- 2025A Different Approach to AI Safety: Proceedings from the Columbia Convening on Openness in Artificial Intelligence and AI Safety
- 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
- 2025Position: AI Safety Must Embrace an Antifragile Perspective