mlsanityData to 14 Oct 2026

Non-Degenerate Risk Certification for Automated Security Decisions: A Decision-Contract Theory with ATT&CK-Aligned Triage as a Worked Instance

arXiv 2608.12444 ↗First posted 12 Aug 2026cs.CR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

An unconditional risk bound on automated decisions can be satisfied without automating anything, since a selector that never acts drives the bound to zero. We show this is structural: any risk certificate is defined over a decision contract, the inputs a system acts on plus the semantic relation under which an output counts correct, and weakening either hides base-classifier error. We develop a decision-contract theory: an error-conservation law showing error is only reassigned among harmful automation, human deferral, and semantic masking; a label-free singleton capacity certifying structural incapacity, with a risk-feasible refinement separating recoverable threshold misalignment from risk-constrained incapacity; and a non-degenerate actionability certificate excluding all-abstain solutions by construction. We instantiate this on ATT&CK-aligned alert triage for LLM-based intrusion detection, the setting that exposed the vacuity failure. Across 3 IDS datasets, 6 LLMs, and 4 error-rate thresholds, empirical false-attribution risk stays at or below target in 90.3% of configurations, with 83.4% mean correct automation. The capacity diagnostic explains every low-utility configuration; its refinement separates genuine misalignment from risk-constrained incapacity, confirmed by an exhibited alternative threshold; a training-stability re-run finds no confirmed structural-incapacity instance; and real fine-grained attack-subtype labels confirm the coarsening-transfer identity under a genuine many-to-one map, with small but non-zero masking mass.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

20 of 31 references.

References · 20

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2023Mistral 7Bcited by 3,164
  5. 2017Selective Classification for Deep Neural Networkscited by 852
  6. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  7. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  8. 2022Conformal Risk Controlcited by 299
  9. 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
  10. 2023Conformal Language Modelingcited by 170
  11. 2022Adaptive Conformal Predictions for Time Seriescited by 161
  12. 2022Safe Planning in Dynamic Environments using Conformal Predictioncited by 119
8 more
  1. 2023Class-Conditional Conformal Prediction with Many Classescited by 109
  2. 2021Fair Conformal Predictors for Applications in Medical Imagingcited by 74
  3. 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 39
  4. 2020Selective Classification via One-Sided Predictioncited by 38
  5. 2023Non-Exchangeable Conformal Risk Controlcited by 29
  6. 2026Conformal Selective Acting: Anytime-Valid Risk Control for RLVR-Trained LLMscited by 8
  7. 2026Entropy Alone is Insufficient for Safe Selective Prediction in LLMscited by 7
  8. 2026When Can Conformal Risk Control Certify LLM Outputs? Bounds, Impossibility, and Adaptation for Structured Generationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agents
  2. 2026AuthGateBench: Benchmarking LLMs as Authorization Gate
  3. 2026The Gate Is Only as Honest as Its Contracts: ContractGuard for the Contract Layer of Risk-Aware Causal Gating
  4. 2026Knowledge Over Parameters: Evolving Smart Contract Vulnerability Detection ↗
  5. 2026Structured but Fragile: On the Limits of LLMs in Cybersecurity Decision-Making
  6. 2026Enforcing Benign Trajectories: A Behavioral Firewall for Structured-Workflow AI Agents
  7. 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls
  8. 2026Expected Harm: Rethinking Safety Evaluation of (Mis)Aligned LLMs