Forecasting Trajectory-Level Safety Risks in Black-Box Multi-Turn Interactions
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) evolve from standalone assistants into autonomous agents, ensuring their safety requires shifting beyond pointwise risk assessment to understand how risks emerge and unfold over long-horizon trajectories. In multi-turn interactions, malicious intent can be decomposed across seemingly harmless turns and gradually reconstructed through interaction trajectories, eventually resulting in safety failures. Existing safeguards remain largely reactive, detecting manifested violations while lacking the ability to predict latent risk evolution and enable preemptive prevention. To address this limitation, we propose Recast, a safety risk forecasting framework that advances LLM safeguarding beyond turn-level violation detection to trajectory-level risk prediction. Recast first retrieves risk-relevant evidence from both short-term dialogue progression and long-term historical context via a dual-scale trajectory view. It then models compositional risk evolution by capturing the current risk configuration and its temporal dynamics. Finally, a causal temporal encoder learns latent risk evolution patterns and predicts the distribution of future risk emergence turns. Extensive experiments across 7 risk categories show that Recast predicts 88.3% of future safety failures with an average lead time of 2.41 turns, while maintaining a false alarm rate of 12.3%, showcasing the effectiveness of trajectory-level forecasting in identifying emerging risks before safety violations occur.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
27 of 36 references.
References · 27
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 240
15 more
- 2023Planning with Large Language Models for Code Generationcited by 182
- 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
- 2025Qwen3Guard Technical Reportcited by 155
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 145
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 132
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 125
- 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 86
- 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77
- 2024Intention Analysis Makes LLMs A Good Jailbreak Defendercited by 74
- 2025Foot-In-The-Door: A Multi-turn Jailbreak for LLMscited by 54
- 2025Tempest: Autonomous Multi-Turn Jailbreaking of Large Language Models with Tree Searchcited by 17
- 2026ICON: Intent-Context Coupling for Efficient Multi-Turn Jailbreak Attackcited by 6
- 2026THRD: A Training-Free Multi-Turn Defense Framework for Jailbreak Attacks on Large Language Modelscited by 2
Built on by
Not cited yet.