mlsanityData to 14 Oct 2026

State-Dependent Safety Failures in Multi-Turn Language Model Interaction

arXiv 2603.15684 ↗First posted 15 Mar 2026cs.CR cs.AIcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Safety alignment in large language models is typically evaluated under isolated queries, yet real-world use is inherently multi-turn. Although multi-turn jailbreaks are empirically effective, the structure of conversational safety failure remains insufficiently understood. In this work, we study safety failures from a state-space perspective and show that many multi-turn safety failures in current safety-aligned language models arise from contextual state evolution, a regime that is not fully captured by isolated prompt-level analyses alone. We introduce STAR, a state-oriented diagnostic framework that treats dialogue history as a state transition operator and enables controlled analysis of safety behavior along interaction trajectories. Rather than optimizing attack strength, STAR provides a principled probe of how aligned models traverse the safety boundary under autoregressive conditioning. Across multiple frontier language models, we find that systems that appear robust under static evaluation can undergo rapid and reproducible safety collapse under structured multi-turn interaction. Mechanistic analysis reveals monotonic drift away from refusal-related representations and abrupt phase transitions induced by role-conditioned context. Together, these findings motivate viewing language model safety as a dynamic, state-dependent process defined over conversational trajectories.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 31 of its 38 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

31 of 38 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundaries31 May
  2. 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 27

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  6. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  7. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  8. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
  9. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
  10. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
  11. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  12. 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 451
15 more
  1. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  2. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  3. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
  4. 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 175
  5. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 125
  6. 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77
  7. 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialoguecited by 66
  8. 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Modelscited by 64
  9. 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 62
  10. 2022CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Modelscited by 53
  11. 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 47
  12. 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Modelscited by 30
  13. 2024Foot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychologycited by 27
  14. 2025A Representation Engineering Perspective on the Effectiveness of Multi-Turn Jailbreakscited by 10
  15. 2024GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Context Flips, Safety Breaks: Diagnosing Brittle Safety in Aligned Language Models
  2. 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks
  3. 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models
  4. 2025MUSE: MCTS-Driven Red Teaming Framework for Enhanced Multi-Turn Dialogue Safety in Large Language Models
  5. 2025SafeMT: Multi-turn Safety for Multimodal Language Models
  6. 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directions
  7. 2026Evaluating Language Model Safety Across Long Adversarial Conversations
  8. 2026When Choices Become Risks: Safety Failures of Large Language Models under Multiple-Choice Constraints