{"total":60,"rows":[{"id":"2501.14249","title":"Humanity's Last Exam","created":"2025-01-24","cited_by_count":491,"area":null},{"id":"2412.04984","title":"Frontier Models are Capable of In-context Scheming","created":"2024-12-06","cited_by_count":287,"area":null},{"id":"2503.14499","title":"Measuring AI Ability to Complete Long Software Tasks","created":"2025-03-18","cited_by_count":156,"area":null},{"id":"2506.02548","title":"CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale","created":"2025-06-03","cited_by_count":78,"area":null},{"id":"2502.11844","title":"BaxBench: Can LLMs Generate Correct and Secure Backends?","created":"2025-02-17","cited_by_count":41,"area":null},{"id":"2512.00193","title":"A Rosetta Stone for AI Benchmarks","created":"2025-11-28","cited_by_count":36,"area":null},{"id":"2503.17354","title":"HCAST: Human-Calibrated Autonomy Software Tasks","created":"2025-03-21","cited_by_count":24,"area":null},{"id":"2508.01059","title":"Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Report","created":"2025-08-01","cited_by_count":23,"area":null},{"id":"2606.07682","title":"SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?","created":"2026-06-05","cited_by_count":23,"area":null},{"id":"2409.10566","title":"Eureka: Evaluating and Understanding Large Foundation Models","created":"2024-09-13","cited_by_count":18,"area":null},{"id":"2603.02277","title":"Quantifying Frontier LLM Capabilities for Container Sandbox Escape","created":"2026-03-01","cited_by_count":18,"area":null},{"id":"2504.19373","title":"Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Models","created":"2025-04-27","cited_by_count":14,"area":null},{"id":"2604.11806","title":"Detecting Safety Violations Across Many Agent Traces","created":"2026-04-13","cited_by_count":14,"area":null},{"id":"2409.19182","title":"Artificial-Intelligence Generated Code Considered Harmful: A Road Map for Secure and High-Quality Code Generation","created":"2024-09-27","cited_by_count":12,"area":null},{"id":"2605.26548","title":"SEC-bench Pro: Can Language Models Solve Long-Horizon Software Security Tasks?","created":"2026-05-26","cited_by_count":9,"area":null},{"id":"2502.06656","title":"A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Management","created":"2025-02-10","cited_by_count":8,"area":null},{"id":"2506.06414","title":"Benchmarking Misuse Mitigation Against Covert Adversaries","created":"2025-06-06","cited_by_count":8,"area":null},{"id":"2603.23994","title":"Understanding the Challenges in Iterative Generative Optimization with LLMs","created":"2026-03-25","cited_by_count":8,"area":null},{"id":"2606.04460","title":"CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities","created":"2026-06-03","cited_by_count":8,"area":null},{"id":"2602.07267","title":"BRIDGE: Predicting Human Task Completion Time From Model Performance","created":"2026-02-06","cited_by_count":6,"area":null},{"id":"2505.11449","title":"LLMs unlock new paths to monetizing exploits","created":"2025-05-16","cited_by_count":5,"area":null},{"id":"2503.04299","title":"Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert Elicitation","created":"2025-03-06","cited_by_count":4,"area":null},{"id":"2604.05719","title":"Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testing","created":"2026-04-07","cited_by_count":4,"area":null},{"id":"2606.14295","title":"AgentCyberRange: Benchmarking Frontier AI Systems in Realistic Cyber Ranges","created":"2026-06-12","cited_by_count":4,"area":null},{"id":"2410.15396","title":"The Best Defense is a Good Offense: Countering LLM-Powered Cyberattacks","created":"2024-10-20","cited_by_count":3,"area":null},{"id":"2507.06893","title":"Developing and Maintaining an Open-Source Repository of AI Evaluations: Challenges and Insights","created":"2025-07-09","cited_by_count":3,"area":null},{"id":"2607.21763","title":"Every Model Cheats: Prompt-Level Mitigation of Cheating on Offensive Cyber Tasks","created":"2026-07-23","cited_by_count":3,"area":null},{"id":"2606.10281","title":"Benchmarking and Exploring the Capabilities of LLMs for Attack Investigations","created":"2026-06-09","cited_by_count":2,"area":null},{"id":"2410.21939","title":"HonestCyberEval: An AI Cyber Risk Benchmark for Automated Software Exploitation","created":"2024-10-29","cited_by_count":1,"area":null},{"id":"2601.22159","title":"RedSage: A Cybersecurity Generalist LLM","created":"2026-01-29","cited_by_count":1,"area":null},{"id":"2604.06019","title":"CritBench: A Framework for Evaluating Cybersecurity Capabilities of Large Language Models in IEC 61850 Digital Substation Environments","created":"2026-04-07","cited_by_count":1,"area":null},{"id":"2604.20389","title":"CyberCertBench: Evaluating LLMs in Cybersecurity Certification Knowledge","created":"2026-04-22","cited_by_count":1,"area":null},{"id":"2605.21773","title":"HIDBench: Benchmarking Large Language Models for Host-Based Intrusion Detection","created":"2026-05-20","cited_by_count":1,"area":null},{"id":"2607.15263","title":"Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents","created":"2026-07-16","cited_by_count":1,"area":null},{"id":"2608.11341","title":"Apodex Discovery: Reality Benchmarks and Environments for Evaluating and Building Discoverative Artificial Intelligence","created":"2026-08-11","cited_by_count":1,"area":null},{"id":"2609.30325","title":"ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?","created":"2026-09-23","cited_by_count":1,"area":null},{"id":"2510.16005","title":"Breaking Guardrails, Facing Walls: Insights on Adversarial AI for Defenders & Researchers","created":"2025-10-14","cited_by_count":0,"area":null},{"id":"2602.08889","title":"Scalable Delphi: Large Language Models for Structured Risk Estimation","created":"2026-02-09","cited_by_count":0,"area":null},{"id":"2604.24966","title":"Risk Reporting for Developers' Internal AI Model Use","created":"2026-04-27","cited_by_count":0,"area":null},{"id":"2605.17416","title":"Benchmarking Mythos-Linked Bug Rediscovery","created":"2026-05-17","cited_by_count":0,"area":null},{"id":"2605.22568","title":"Measuring Security Without Fooling Ourselves: Why Benchmarking Agents Is Hard","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2605.29115","title":"unix-ctf: Procedural Environments for Unix-Competence Reinforcement Learning","created":"2026-05-27","cited_by_count":0,"area":null},{"id":"2606.29175","title":"Direct Causation in International Humanitarian Law and the Challenge of AI-Mediated Civilian Cyber Operations","created":"2026-06-28","cited_by_count":0,"area":null},{"id":"2607.01764","title":"Mastermind: Strategy-grounded Learning for Repository-Scale Vulnerability Reproduction","created":"2026-07-02","cited_by_count":0,"area":null},{"id":"2607.03215","title":"Builder, Defender, Breaker: Measurable Independence and Bounded Autonomy When Generative Models Build, Defend and Test Software","created":"2026-07-03","cited_by_count":0,"area":null},{"id":"2607.16112","title":"Harmonizing AI Safety Thresholds","created":"2026-07-17","cited_by_count":0,"area":null},{"id":"2607.25425","title":"The Disruptive Impact of Large Language Models on Capture the Flag Competitions and the Path Toward Fair Play","created":"2026-07-28","cited_by_count":0,"area":null},{"id":"2607.25891","title":"Messier: A High-Resolution Corpus for Cross-Benchmark Agent Evaluation","created":"2026-07-28","cited_by_count":0,"area":null},{"id":"2608.05797","title":"Predicting Task Difficulty Without Rollouts","created":"2026-08-06","cited_by_count":0,"area":null},{"id":"2608.14940","title":"When Is an Agent Evaluation Over? Outcome Finality and Cross-Unit Separation","created":"2026-08-14","cited_by_count":0,"area":null},{"id":"2608.15012","title":"SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system","created":"2026-08-15","cited_by_count":0,"area":null},{"id":"2608.26882","title":"PLCBench: Can Autonomous LLM Agents Turn PLC Access into Sustained Physical Impact?","created":"2026-08-27","cited_by_count":0,"area":null},{"id":"2609.01611","title":"EvalDetectBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Models","created":"2026-06-08","cited_by_count":0,"area":null},{"id":"2609.08418","title":"Feyospace-v1: How the Cyber Mercury Seven Trained Frontier Cyber Models","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.15383","title":"Divide, Consult, Conquer: Capability Laundering Through Aligned LLMs","created":"2026-09-14","cited_by_count":0,"area":null},{"id":"2609.18120","title":"PentestChain: A Cost-Aware, MCP-Orchestrated Framework for Automated Penetration Testing with Free-Tier LLMs","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.20614","title":"Inference-Engine Fingerprinting Attacks are Practical: Exploring Model-Driven Environmental Discovery, Exploitation, and Escape","created":"2026-09-17","cited_by_count":0,"area":null},{"id":"2609.38954","title":"APTInvestBench: Evaluating Autonomous APT Investigation under Varying Telemetry","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.04379","title":"AgentPersonaBench: Benchmarking Persona-Driven User Simulation","created":"2026-10-03","cited_by_count":0,"area":null},{"id":"2610.06584","title":"Does AI Help Cyber Attackers or Defenders? Evidence from Nonpublic Vulnerabilities and Subsequent Attacks","created":"2026-10-05","cited_by_count":0,"area":null}],"next_cursor":null}