mlsanityData to 14 Oct 2026

TRACE: Trajectory Risk-Aware Compression for Long-Horizon Agent Safety

arXiv 2606.00611 ↗First posted 30 May 2026cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Long-horizon LLM agents produce safety evidence across long trajectories, where sparse, delayed, and compositional risk signals often escape local moderation. Existing turn-level or short-context detectors struggle to reliably retain and aggregate such evidence over extended horizons. We reframe long-horizon agent safety detection as trajectory-level evidence compression and propose Trajectory Risk-Aware Compression for Long-Horizon Agent Safety (TRACE). TRACE uses a Compressor-Reader design: the Compressor encodes the full trajectory into a compact latent evidence state under trajectory-level supervision, and the Reader judges the raw trajectory with this latent evidence state as a safety reference. This design helps aggregate dispersed risk cues and reduce premature evidence loss. Across ASSEBench, Pre-Ex-Bench, and R-Judge, TRACE achieves the best accuracy on all evaluated backbones, improving over strong baselines by up to 12.6 percentage points. On LongSafety, TRACE shows smaller performance degradation as context length grows. Attention visualizations and case studies suggest that the compressed reference helps the Reader focus on risk-critical segments and recover cross-step evidence. Code is available at https://github.com/Peregrine123/TRACE_official.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 24 of its 31 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

24 of 31 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Safeguarding LLM Agents against Long-Horizon Threats via Shadow Memory4 May
  2. 2026AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks18 Feb
  3. 2026Information-Theoretic Privacy Control for Sequential Multi-Agent LLM Systems13 Feb
  4. 2025Agent Tools Orchestration Leaks More: Dataset, Benchmark, and Mitigation18 Dec
  5. 2025When Refusals Fail: Unstable Safety Mechanisms in Long-Context LLM Agents2 Dec
  6. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data10 Oct
  7. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  8. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
  9. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  10. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  11. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
  12. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 12

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  4. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  5. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  6. 2016Deep Variational Information Bottleneckcited by 930
  7. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  8. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  9. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
  10. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 109
  11. 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 82
  12. 2024LongSafety: Enhance Safety for Long-Context LLMscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemRiskBench: Trace-Aware Risk-Preserving Evaluation for Long-Horizon LLM Agents
  2. 2026TRACE: Trajectory Reasoning through Adaptive Cross-Step Evidence Aggregation for LLM Agents
  3. 2026HINTBench: Horizon-agent Intrinsic Non-attack Trajectory Benchmark
  4. 2026TRACES: Proactive Safety Auditing for Multi-Turn LLM Agents via Trajectory-State Modeling
  5. 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis
  6. 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
  7. 2026DRAFT: Task Decoupled Latent Reasoning for Agent Safety
  8. 2026Slipstream: Trajectory-Grounded Compaction Validation for Long-Horizon Agents