mlsanityData to 7 Oct 2026

Do LLMs Follow Their Own Rules? A Reflexive Audit of Self-Stated Safety Policies

arXiv 2604.09189 ↗First posted 10 Apr 2026cs.CL cs.AI cs.LGcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

Abstract (arXiv)

LLMs internalize safety policies through RLHF, yet these policies are never formally specified and remain difficult to inspect. Existing benchmarks evaluate models against external standards but do not measure whether models understand and enforce their own stated boundaries. We introduce the Symbolic-Neural Consistency Audit (SNCA), a framework that (1) extracts a model's self-stated safety rules via structured prompts, (2) formalizes them as typed predicates (Absolute, Conditional, Adaptive), and (3) measures behavioral compliance via deterministic comparison against harm benchmarks. Evaluating four frontier models across 45 harm categories and 47,496 observations reveals systematic gaps between stated policy and observed behavior: models claiming absolute refusal frequently comply with harmful prompts, reasoning models achieve the highest self-consistency but fail to articulate policies for 29% of categories, and cross-model agreement on rule types is remarkably low (11%). These results demonstrate that the gap between what LLMs say and what they do is measurable and architecture-dependent, motivating reflexive consistency audits as a complement to behavioral benchmarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 14 of its 16 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

14 of 16 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal20 Jun
  2. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Models31 May

Other references · 12

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  6. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
  7. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  8. 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
  9. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  10. 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?cited by 56
  11. 2023Self-Guard: Empower the LLM to Safeguard Itselfcited by 52
  12. 2023Can LLMs Follow Simple Rules?cited by 45

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models
  2. 2025Self-Guided Adaptive Safety Alignment: Synthesizing and Internalizing Guidelines in Reasoning Models
  3. 2025Safety Compliance: Rethinking LLM Safety Reasoning through the Lens of Compliance
  4. 2026Reducing the Safety Tax in LLM Safety Alignment with On-Policy Self-Distillation
  5. 2025Evaluating LLM Agent Adherence to Hierarchical Safety Principles: A Lightweight Benchmark for Probing Foundational Controllability Components
  6. 2026Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations
  7. 2025How Effective Is Constitutional AI in Small LLMs? A Study on DeepSeek-R1 and Its Peers
  8. 2026Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety