mlsanityData to 14 Oct 2026

Safety Context Injection: Inference-Time Safety Alignment via Static Filtering and Agentic Analysis

arXiv 2605.11664 ↗First posted 12 May 2026cs.CRcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 2 more
Abstract (arXiv)

Large Reasoning Models (LRMs) improve performance on complex tasks, but they also make safety control harder at deployment time. In black-box settings, defenders cannot modify model weights and must instead intervene at inference time. This setting creates three practical challenges: harmful intent may be hidden by educational or role-play framing, deep safety analysis can introduce non-trivial latency, and long adversarial contexts can dilute the local cues that simpler filters rely on. These challenges can expose an apparent thinking--output gap, where the model appears cautious during reasoning but still produces an unsafe final answer. To address this problem, we propose Safety Context Injection (SCI), an inference-time framework that separates safety assessment from task generation and prepends a structured external risk report as injected safety context for the protected model. The framework is instantiated in two complementary variants: Static Model Filtering (SMF), a lightweight one-pass guard for fast deployment, and Dynamic Agents Filtering (DAF), an agentic-loop-based analyzer that iteratively gathers and synthesizes evidence for ambiguous or long-context attacks. Across AdvBench and GPTFuzz, spanning base and reasoning models under five jailbreak families, both variants reduce attack success rate and toxicity in the evaluated settings. SMF offers an efficient low-latency option, while DAF is more effective when harmful intent is semantically disguised or dispersed across long contexts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 24 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

15 of 24 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  5. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  6. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  7. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingcited by 247
  8. 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritizationcited by 170
  9. 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 157
  10. 2024Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstructioncited by 107
  11. 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Modelscited by 86
  12. 2024Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchycited by 67
3 more
  1. 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injectioncited by 59
  2. 2025AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Modelscited by 7
  3. 2025Chain-of-Lure: A Universal Jailbreak Attack Framework using Unconstrained Synthetic Narrativescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Self-Guided Adaptive Safety Alignment: Synthesizing and Internalizing Guidelines in Reasoning Models
  2. 2026Enhancing Agent Safety Judgment: Controlled Benchmark Rewriting and Analogical Reasoning for Deceptive Out-of-Distribution Scenarios
  3. 2026DRAFT: Task Decoupled Latent Reasoning for Agent Safety
  4. 2026Internalizing Safety Understanding in Large Reasoning Models via Verification
  5. 2026Beyond Routine Compliance: Cunning Data Cultivates Safety Vigilance in Large Language Models
  6. 2026Adaptive and Explicit safe: Triggering Latent Safety Awareness in Large Reasoning Models
  7. 2026Self-Guard: Defending Large Reasoning Models via enhanced self-reflection
  8. 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models