JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety
Not on the map. Why?
Abstract (arXiv)
Agent safety is moving from content moderation toward preventing operational failures before tool-using agents act. We propose Janus, a foresight-oriented framework for long-horizon agent safety that trains guards to anticipate delayed risks from partial trajectories. Janus synthesizes diverse agent trajectories via multi-agent simulation and learns a shared policy with two coupled tasks: an anticipation task that forecasts safety-relevant futures and an adjudication task that decides safety from both the observed prefix and anticipated future. The two tasks are jointly optimized with CoAA-RL, which rewards forecasts by their utility for downstream safety judgment. The resulting guard model, Vanguard, blocks unsafe actions before execution. Across four agent-safety benchmarks, Vanguard improves average protection by 15.9 percentage points over baseline guards while increasing benign task completion by 5.1 percentage points.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 30 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
25 of 30 references.
References · 25
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoningcited by 144
- 2025Qwen3Guard Technical Reportcited by 125
13 more
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 122
- 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 114
- 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detectioncited by 82
- 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agentscited by 82
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 64
- 2026Dive into Claude Code: The Design Space of Today's and Future AI Agent Systemscited by 33
- 2026AgentLAB: Benchmarking LLM Agents against Long-Horizon Attackscited by 31
- 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agentcited by 27
- 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Datacited by 26
- 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Modelscited by 11
- 2026LPS-Bench: Benchmarking Safety Awareness of Computer-Use Agents in Long-Horizon Planning under Benign and Adversarial Scenarioscited by 8
- 2025AgentPack: A Dataset of Code Changes, Co-Authored by Agents and Humanscited by 4
- 2026TabSieve: Explicit In-Table Evidence Selection for Tabular Predictioncited by 4
Built on by
Not cited yet.