REA: From Correct LLM Judgments to Safe Decision Delivery
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Generative safety guards must classify requests correctly and return outputs that applications can parse. Reasoning guards can improve classification accuracy while producing outputs that applications cannot parse. When applications cannot extract a correct prediction, fallback handling can allow harmful requests or block safe ones. We introduce Resolve--Express--Act (REA), a framework that traces judgments through parsing and fallback to application actions. Experiments on classifiers and safety guards show that correct predictions can appear in incorrectly formatted outputs. Parsing the safety verdict preserves the reasoning guard's accuracy advantage, while stricter explanation requirements reject additional correct predictions. Accepting formatting variations recovers most rejected correct predictions. Held-out tests confirm that output requirements and generation limits affect whether correct predictions can be parsed. In our fail-open replay, matching the parser to the output and fixing formatting reduced the fraction of harmful requests allowed despite correct guard judgments from 95.5% to 0%. A fixed-output comparison shows that model-based extraction can preserve guard verdicts, but is not automatically reliable; deterministic normalization already repairs the observed native-format failures. Fallback replay shows that the same correct prediction can lead to different safety actions depending on the parser and fallback policy, including allowing requests the guard correctly identifies as harmful.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 14 of its 32 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
14 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguards30 Jan
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs26 Jun
Other references · 12
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2025IHEval: Evaluating Language Models on Following the Instruction Hierarchycited by 53
- 2025Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMscited by 30
- 2025When Grammar Guides the Attack: Uncovering Control-Plane Vulnerabilities in LLMs with Structured Outputcited by 4
- 2026When the Ruler is Broken: Parsing-Induced Suppression in LLM-Based Security Log Evaluationcited by 3
- 2026AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agentscited by 2
- 2026How Reliable Is Your Jailbreak Judge? Calibration and Adversarial Robustness of Automated ASR Scoringcited by 2
- 2026CheatBench: Measuring Reward Gaming in AI Agentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models
- 2026CourtGuard: A Model-Agnostic Framework for Zero-Shot Policy Adaptation in LLM Safety
- 2026RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for LLM Agents
- 2026Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers
- 2026DT-Guard: Intent-Driven Reasoning-Active Training for Reasoning-Free LLM Safety Guardrail
- 2026Safety Paradox: How Enhanced Safety Awareness Leaves LLMs Vulnerable to Posterior Attack
- 2026Enhancing Agent Safety Judgment: Controlled Benchmark Rewriting and Analogical Reasoning for Deceptive Out-of-Distribution Scenarios
- 2026SafeThinker: Reasoning about Risk to Deepen Safety Beyond Shallow Alignment