State-Dependent Safety Failures in Multi-Turn Language Model Interaction
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Safety alignment in large language models is typically evaluated under isolated queries, yet real-world use is inherently multi-turn. Although multi-turn jailbreaks are empirically effective, the structure of conversational safety failure remains insufficiently understood. In this work, we study safety failures from a state-space perspective and show that many multi-turn safety failures in current safety-aligned language models arise from contextual state evolution, a regime that is not fully captured by isolated prompt-level analyses alone. We introduce STAR, a state-oriented diagnostic framework that treats dialogue history as a state transition operator and enables controlled analysis of safety behavior along interaction trajectories. Rather than optimizing attack strength, STAR provides a principled probe of how aligned models traverse the safety boundary under autoregressive conditioning. Across multiple frontier language models, we find that systems that appear robust under static evaluation can undergo rapid and reproducible safety collapse under structured multi-turn interaction. Mechanistic analysis reveals monotonic drift away from refusal-related representations and abrupt phase transitions induced by role-conditioned context. Together, these findings motivate viewing language model safety as a dynamic, state-dependent process defined over conversational trajectories.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 31 of its 38 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
31 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2024Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundaries31 May
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 27
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024GPT-4o System Cardcited by 4,588
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 451
15 more
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
- 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 175
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 125
- 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77
- 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialoguecited by 66
- 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Modelscited by 64
- 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 62
- 2022CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Modelscited by 53
- 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 47
- 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Modelscited by 30
- 2024Foot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychologycited by 27
- 2025A Representation Engineering Perspective on the Effectiveness of Multi-Turn Jailbreakscited by 10
- 2024GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Modelscited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SafeDream: Safety World Model for Proactive Early Jailbreak Detectioncited by 2
- 2026Mitigating Scaffolding Collapse in Socratic Tutors via Representation Alignmentcited by 0
- 2026Jailbreak Context Lingers: Divergent Safety Routing and Its Cross-Task Predictability in Tool Agentscited by 0
- 2026TRACE: Trajectory Return Attribution and Contrastive Erasure for Multi-Turn Safetycited by 0
- 2026TRACE: Trajectory Return Attribution and Contrastive Erasure for Multi-Turn Safety1 Oct 2026
- 2026Jailbreak Context Lingers: Divergent Safety Routing and Its Cross-Task Predictability in Tool Agents28 Sep 2026
- 2026Mitigating Scaffolding Collapse in Socratic Tutors via Representation Alignment15 Jun 2026
- 2026SafeDream: Safety World Model for Proactive Early Jailbreak Detection18 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026When Context Flips, Safety Breaks: Diagnosing Brittle Safety in Aligned Language Models
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks
- 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models
- 2025MUSE: MCTS-Driven Red Teaming Framework for Enhanced Multi-Turn Dialogue Safety in Large Language Models
- 2025SafeMT: Multi-turn Safety for Multimodal Language Models
- 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directions
- 2026Evaluating Language Model Safety Across Long Adversarial Conversations
- 2026When Choices Become Risks: Safety Failures of Large Language Models under Multiple-Choice Constraints