Constitutional Classifiers++: Efficient Production-Grade Defenses against Universal Jailbreaks
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
We introduce enhanced Constitutional Classifiers that deliver production-grade jailbreak robustness with dramatically reduced computational costs and refusal rates compared to previous-generation defenses. Our system combines several key insights. First, we develop exchange classifiers that evaluate model responses in their full conversational context, which addresses vulnerabilities in last-generation systems that examine outputs in isolation. Second, we implement a two-stage classifier cascade where lightweight classifiers screen all traffic and escalate only suspicious exchanges to more expensive classifiers. Third, we train efficient linear probe classifiers and ensemble them with external classifiers to simultaneously improve robustness and reduce computational costs. Together, these techniques yield a production-grade system achieving a 40x computational cost reduction compared to our baseline exchange classifier, while maintaining a 0.05% refusal rate on production traffic. Through extensive red-teaming comprising over 1,700 hours, we demonstrate strong protection against universal jailbreaks -- no attack on this system successfully elicited responses to all eight target queries comparable in detail to an undefended model. Our work establishes Constitutional Classifiers as practical and efficient safeguards for large language models.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 19 of its 28 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
19 of 28 references.
Closest ancestors · 3
Same direction, newest first
- 2025The Jailbreak Tax: How Useful are Your Jailbreak Outputs?14 Apr
- 2025Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming31 Jan
- 2024A StrongREJECT for Empty Jailbreaks15 Feb
Other references · 16
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2025Gemma 3 Technical Reportcited by 1,686
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2019On Evaluating Adversarial Robustnesscited by 442
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
- 2025Are Sparse Autoencoders Useful? A Case Study in Sparse Probingcited by 109
- 2024Defending Against Unforeseen Failure Modes with Latent Adversarial Trainingcited by 82
- 2025Detecting High-Stakes Interactions with Activation Probescited by 45
4 more
- 2025Reasoning as an Adaptive Defense for Safetycited by 22
- 2025Gatekeeper: Improving Model Cascades Through Confidence Tuningcited by 10
- 2025Combining Cost-Constrained Runtime Monitors for AI Safetycited by 10
- 2025Towards Safeguarding LLM Fine-tuning APIs against Cipher Attackscited by 10
Built on by
Citing papers per year: 2026: 36.
36 papers.
Sort:
By area:
- 2026Building Production-Ready Probes For Geminicited by 38
- 2026When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shiftcited by 8
- 2026Boundary Point Jailbreaking of Black-Box LLMscited by 7
- 2026Proof-of-Guardrail in AI Agents and What (Not) to Trust from Itcited by 4
- 2026Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamicscited by 4
- 2026Verbalizing LLMs' assumptions to explain and control sycophancycited by 3
- 2026Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensemblingcited by 3
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMscited by 3
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 3
- 2026Position: Capability Control Should be a Separate Goal From Alignmentcited by 2
- 2026Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Familiescited by 2
- 2026When Models Examine Themselves: Vocabulary-Activation Correspondence in Self-Referential Processingcited by 1
24 more
- 2026Probing the Misaligned Thinking Process of Language Modelscited by 1
- 2026Safeguard-Conditioned Uplift: Measuring Utility-Risk Frontiers for Dual-Use Biology Assistantscited by 1
- 2026Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluationscited by 1
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Modelscited by 1
- 2026BarrierSteer: LLM Safety via Learning Barrier Steeringcited by 0
- 2026Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Modelscited by 0
- 2026Do Linear Probes Generalize Better in Persona Coordinates?cited by 0
- 2026How Useful Is Cross-Domain Generalization for Training LLM Monitors?cited by 0
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifierscited by 0
- 2026Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluationcited by 0
- 2026D2-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation Signalscited by 0
- 2026Stateful Online Monitoring Catches Distributed Agent Attackscited by 0
- 2026Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputscited by 0
- 2026BioSecBench-Refusal: A paired metric for performance and alignment in agentic biosecurity risk assessmentcited by 0
- 2026Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal Statescited by 0
- 2026Magnet: Detecting Cross-Session AI Misuse Through Capability Accumulationcited by 0
- 2026SingProbe Technical Reportcited by 0
- 2026The Safeguard Worked. Is the LLM System Safer?cited by 0
- 2026Safety Monitors Mostly Catch What the Model Already Refusescited by 0
- 2026Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuningcited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026Constitutional adapters: Inference-time interventions for misalignment and misusecited by 0
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisationcited by 0
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deceptioncited by 0
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception8 Oct 2026
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation29 Sep 2026
- 2026Constitutional adapters: Inference-time interventions for misalignment and misuse29 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models16 Sep 2026
- 2026Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations16 Sep 2026
- 2026Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuning9 Sep 2026
- 2026Safety Monitors Mostly Catch What the Model Already Refuses5 Sep 2026
- 2026The Safeguard Worked. Is the LLM System Safer?1 Sep 2026
- 2026SingProbe Technical Report31 Aug 2026
- 2026Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Families8 Aug 2026
- 2026Magnet: Detecting Cross-Session AI Misuse Through Capability Accumulation3 Aug 2026
24 more
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States1 Aug 2026
- 2026Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal States13 Jul 2026
- 2026BioSecBench-Refusal: A paired metric for performance and alignment in agentic biosecurity risk assessment6 Jul 2026
- 2026Probing the Misaligned Thinking Process of Language Models23 Jun 2026
- 2026Safeguard-Conditioned Uplift: Measuring Utility-Risk Frontiers for Dual-Use Biology Assistants12 Jun 2026
- 2026Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputs9 Jun 2026
- 2026Stateful Online Monitoring Catches Distributed Agent Attacks29 May 2026
- 2026D2-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation Signals25 May 2026
- 2026Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluation22 May 2026
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifiers21 May 2026
- 2026Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics18 May 2026
- 2026How Useful Is Cross-Domain Generalization for Training LLM Monitors?12 May 2026
- 2026Do Linear Probes Generalize Better in Persona Coordinates?10 May 2026
- 2026Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Models30 Apr 2026
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMs16 Apr 2026
- 2026Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling15 Apr 2026
- 2026Verbalizing LLMs' assumptions to explain and control sycophancy3 Apr 2026
- 2026Proof-of-Guardrail in AI Agents and What (Not) to Trust from It6 Mar 2026
- 2026BarrierSteer: LLM Safety via Learning Barrier Steering23 Feb 2026
- 2026Boundary Point Jailbreaking of Black-Box LLMs16 Feb 2026
- 2026When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift15 Feb 2026
- 2026When Models Examine Themselves: Vocabulary-Activation Correspondence in Self-Referential Processing11 Feb 2026
- 2026Position: Capability Control Should be a Separate Goal From Alignment5 Feb 2026
- 2026Building Production-Ready Probes For Gemini16 Jan 2026
- 2026Building Production-Ready Probes For Geminicited by 38
- 2026Boundary Point Jailbreaking of Black-Box LLMscited by 7
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMscited by 3
- 2026Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Familiescited by 2
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Modelscited by 1
- 2026BarrierSteer: LLM Safety via Learning Barrier Steeringcited by 0
- 2026Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Modelscited by 0
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifierscited by 0
- 2026SingProbe Technical Reportcited by 0
- 2026Safety Monitors Mostly Catch What the Model Already Refusescited by 0
- 2026Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuningcited by 0
- 2026Constitutional adapters: Inference-time interventions for misalignment and misusecited by 0
12 most cited of 13 All 13 (JSON)
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation29 Sep 2026
- 2026Constitutional adapters: Inference-time interventions for misalignment and misuse29 Sep 2026
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models16 Sep 2026
- 2026Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuning9 Sep 2026
- 2026Safety Monitors Mostly Catch What the Model Already Refuses5 Sep 2026
- 2026SingProbe Technical Report31 Aug 2026
- 2026Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Families8 Aug 2026
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifiers21 May 2026
- 2026Minimal, Local, Causal Explanations for Jailbreak Success in Large Language Models30 Apr 2026
- 2026Segment-Level Coherence for Robust Harmful Intent Probing in LLMs16 Apr 2026
- 2026BarrierSteer: LLM Safety via Learning Barrier Steering23 Feb 2026
- 2026Boundary Point Jailbreaking of Black-Box LLMs16 Feb 2026
12 newest of 13 All 13 (JSON)
- 2026When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shiftcited by 8
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 3
- 2026Stateful Online Monitoring Catches Distributed Agent Attackscited by 0
- 2026BioSecBench-Refusal: A paired metric for performance and alignment in agentic biosecurity risk assessmentcited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States1 Aug 2026
- 2026BioSecBench-Refusal: A paired metric for performance and alignment in agentic biosecurity risk assessment6 Jul 2026
- 2026Stateful Online Monitoring Catches Distributed Agent Attacks29 May 2026
- 2026When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift15 Feb 2026
- 2026Proof-of-Guardrail in AI Agents and What (Not) to Trust from Itcited by 4
- 2026Verbalizing LLMs' assumptions to explain and control sycophancycited by 3
- 2026Position: Capability Control Should be a Separate Goal From Alignmentcited by 2
- 2026When Models Examine Themselves: Vocabulary-Activation Correspondence in Self-Referential Processingcited by 1
- 2026Safeguard-Conditioned Uplift: Measuring Utility-Risk Frontiers for Dual-Use Biology Assistantscited by 1
- 2026Do Linear Probes Generalize Better in Persona Coordinates?cited by 0
- 2026How Useful Is Cross-Domain Generalization for Training LLM Monitors?cited by 0
- 2026Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluationcited by 0
- 2026D2-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation Signalscited by 0
- 2026Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputscited by 0
- 2026Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal Statescited by 0
- 2026Magnet: Detecting Cross-Session AI Misuse Through Capability Accumulationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception8 Oct 2026
- 2026The Safeguard Worked. Is the LLM System Safer?1 Sep 2026
- 2026Magnet: Detecting Cross-Session AI Misuse Through Capability Accumulation3 Aug 2026
- 2026Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal States13 Jul 2026
- 2026Safeguard-Conditioned Uplift: Measuring Utility-Risk Frontiers for Dual-Use Biology Assistants12 Jun 2026
- 2026Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputs9 Jun 2026
- 2026D2-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation Signals25 May 2026
- 2026Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluation22 May 2026
- 2026How Useful Is Cross-Domain Generalization for Training LLM Monitors?12 May 2026
- 2026Do Linear Probes Generalize Better in Persona Coordinates?10 May 2026
- 2026Verbalizing LLMs' assumptions to explain and control sycophancy3 Apr 2026
- 2026Proof-of-Guardrail in AI Agents and What (Not) to Trust from It6 Mar 2026
12 newest of 14 All 14 (JSON)