GAVEL: Towards Rule-Based Safety Through Activation Monitoring
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly paired with activation-based monitoring to detect and prevent harmful behaviors that may not be apparent at the surface-text level. However, existing activation safety approaches, trained on broad misuse datasets, struggle with poor precision, limited flexibility, and lack of interpretability. This paper introduces a new paradigm: rule-based activation safety, inspired by rule-sharing practices in cybersecurity. We propose modeling activations as cognitive elements (CEs), fine-grained, interpretable factors such as 'making a threat' and 'payment processing', that can be composed to capture nuanced, domain-specific behaviors with higher precision. Building on this representation, we present a practical framework that defines predicate rules over CEs and detects violations in real time. This enables practitioners to configure and update safeguards without retraining models or detectors, while supporting transparency and auditability. Our results show that compositional rule-based activation safety improves precision, supports domain customization, and lays the groundwork for scalable, interpretable, and auditable AI governance. We open source GAVEL and introduce GAVEL Studio, an interactive rule authoring and management tool. Code and datasets are available at github.com/Offensive-AI-Lab/gavel.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
21 of 34 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 322
- 2024Programming Refusal with Conditional Activation Steeringcited by 206
9 more
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 183
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 95
- 2025JBShield: Defending Large Language Models from Jailbreak Attacks through Activated Concept Analysis and Manipulationcited by 54
- 2025Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Modelscited by 34
- 2025Representation Bending for Large Language Model Safetycited by 30
- 2025SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signalscited by 29
- 2024Measure-Observe-Remeasure: An Interactive Paradigm for Differentially-Private Exploratory Analysiscited by 24
- 2024Legilimens: Practical and Unified Content Moderation for Large Language Model Servicescited by 13
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Architecture Determines Observability of Transformerscited by 0
- 2026Same Payload, Different Channel: Measuring Trust Asymmetry in Tool-Using Language Modelscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026From Alignment to Access Control: A Framework for GenAI Policy Enforcementcited by 0
- 2026Coverage, Not Difficulty, Sets How Much Synthetic Data an Activation Probe Needscited by 0
- 2026Coverage, Not Difficulty, Sets How Much Synthetic Data an Activation Probe Needs6 Oct 2026
- 2026From Alignment to Access Control: A Framework for GenAI Policy Enforcement22 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Same Payload, Different Channel: Measuring Trust Asymmetry in Tool-Using Language Models30 May 2026
- 2026Architecture Determines Observability of Transformers27 Apr 2026