mlsanityData to 14 Oct 2026

StepSafe: Learning Timely Intervention with Context-Aware Safety Reasoning

arXiv 2610.20960 ↗First posted 14 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance also fits: Reinforcement learning for LLM agents

also in 1 more
Abstract (arXiv)

Safety in agentic systems is inherently sequential: whether an action is safe depends on prior actions, tool outputs, information disclosures, and interactions among agents. Recent work has shifted agent safety guardrails from post-hoc trajectory-level assessment toward step-level action diagnosis and proactive risk prediction, yet existing training objectives provide limited supervision for how step evidence accumulates over time and when it becomes sufficient to justify intervention. We propose methodlong~(ASPO): a training framework for step-level timely intervention. Pre-fix level stage alignment allows crediting each decision at its own step: it compares each response with the other responses sampled at the same prefix and rewards the action that fits the stage, continuing before the risk is visible, asking while clarification can still avert harm, and stopping before harm is irreversible. Adaptive feedback self-distillation further credits the reasoning behind each decision, with the model itself as a teacher that sees the step annotations on intervention steps and rules mined from its own false alarms on safe steps. Its training data carry a violation taxonomy and an intervention window at every step and are extended through self-evolving multi-agent red-teaming. Finally we present textscStepSafe, a step-level reasoning guardrail with timely intervention, that achieves the state-of-the-art peformance among open-source guardrails across five agent-safety benchmarks on safety-utility pareto curve with Youden's J of 53.0 (4B) against 46.2.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. First posted on arXiv 14 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
  2. 2025Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction
  3. 2026DRAFT: Task Decoupled Latent Reasoning for Agent Safety
  4. 2026Enhancing Agent Safety Judgment: Controlled Benchmark Rewriting and Analogical Reasoning for Deceptive Out-of-Distribution Scenarios
  5. 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis
  6. 2026Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use
  7. 2026From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
  8. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data