mlsanityData to 14 Oct 2026

Surviving the Unseen: Predictive Defense for Novel Multi-Turn Multimodal Attacks

arXiv 2605.18988 ↗First posted 18 May 2026cs.CR cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

The expansion of Multimodal Large Language Models (MLLMs) and their integration into autonomous agentic workflows has introduced a non-stationary attack surface. Empirical observations indicate that adversaries employ progressive, cross-modal perturbations that evade turn-specific guardrails by distributing malicious intent across longitudinal conversational trajectories. Static defense mechanisms, constrained by the Markov property, evaluate inputs in isolation and fail to detect cumulative structural poisoning. To handle this limitation, this paper formulates safety verification as a dynamic survival prediction and trajectory dynamics problem. The Triple-tier Anomaly Defense (TRIAD) framework is proposed as a predictive model that maps multimodal and multi-turn conversational flow as a continuous trajectory. The framework integrates structural anomaly detection to monitor covariance shifts, a Ledoit-Wolf regularized Mahalanobis distance to monitor covariance shifts in high-dimensional spaces, and topological trajectory acceleration to differentiate benign creative exploration from continuous malicious drift. These kinematic and geometric features are integrated into a time-varying Cox Proportional Hazards model via a Bayesian Hidden Markov Model (HMM) feedback loop. Theoretical analysis demonstrates that the TRIAD framework provides a mathematically bounded expected time-to-failure under adversarial perturbations, ensuring that malicious acceleration diverges positively. This framework provides a computationally efficient, interpretable, and predictive safeguard for real-time agentic AI systems, establishing a rigorous foundation for continuous safety alignment without relying on empirical retraining.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 25 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

16 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct

Other references · 15

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  3. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  4. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  5. 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
  6. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  7. 2016DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Networkcited by 358
  8. 2025Foot-In-The-Door: A Multi-turn Jailbreak for LLMscited by 54
  9. 2025Mahalanobis++: Improving OOD Detection via Feature Normalizationcited by 32
  10. 2025Multi-lingual Multi-turn Automated Red Teaming for LLMscited by 13
  11. 2025Time-To-Inconsistency: A Survival Analysis of Large Language Model Robustness to Adversarial Attackscited by 6
  12. 2025Detecting LLM-Assisted Academic Dishonesty using Keystroke Dynamicscited by 4
3 more
  1. 2026Toward Universal and Transferable Jailbreak Attacks on Vision-Language Modelscited by 4
  2. 2025PolyJailbreak: Cross-Modal Jailbreaking Attacks on Black-Box Multimodal LLMscited by 3
  3. 2026Multi-turn Jailbreaking Attack in Multi-Modal Large Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026THRD: A Training-Free Multi-Turn Defense Framework for Jailbreak Attacks on Large Language Models
  2. 2026Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures
  3. 2026One Turn Too Late: Learning When to Intervene Against Multi-Turn Malicious Intent
  4. 2026ADVERSA: Measuring Multi-Turn Guardrail Degradation and Judge Reliability in Large Language Models
  5. 2025SafeMT: Multi-turn Safety for Multimodal Language Models
  6. 2026Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards
  7. 2026The Geometry of Harmfulness in Multi-Turn Attacks
  8. 2026The Anatomy of Conversational Scams: A Topic-Based Red Teaming Analysis of Multi-Turn Interactions in LLMs