mlsanityData to 14 Oct 2026

AgentSight: System-Level Observability for AI Agents Using eBPF

arXiv 2508.02736 ↗First posted 2 Aug 2025cs.OS cs.SEcited by 21

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Modern software infrastructure increasingly relies on LLM agents for development and maintenance, such as Claude Code and Gemini-cli. However, these AI agents differ fundamentally from traditional deterministic software, posing a significant challenge to conventional monitoring and debugging. This creates a critical semantic gap: existing tools observe either an agent's high-level intent (via LLM prompts) or its low-level actions (e.g., system calls), but cannot correlate these two views. This blindness makes it difficult to distinguish between benign operations, malicious attacks, and costly failures. We introduce AgentSight, an AgentOps observability framework that bridges this semantic gap using a hybrid approach. Our approach, boundary tracing, monitors agents from outside their application code at stable system interfaces using eBPF. AgentSight intercepts TLS-encrypted LLM traffic to extract semantic intent, monitors kernel events to observe system-wide effects, and causally correlates these two streams across process boundaries using a real-time engine and secondary LLM analysis. This instrumentation-free technique is framework-agnostic, resilient to rapid API changes, and incurs less than 3% performance overhead. Our evaluation shows AgentSight detects prompt injection attacks, identifies resource-wasting reasoning loops, and reveals hidden coordination bottlenecks in multi-agent systems. AgentSight is released as an open-source project at https://github.com/agent-sight/agentsight.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 5 of its 23 references that are in the map. First posted on arXiv 2 Aug 2025.

Builds on

5 of 23 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 4

  1. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  2. 2024AgentOps: Enabling Observability of LLM Agentscited by 46
  3. 2025Because we have LLMs, we Can and Should Pursue Agentic Interpretabilitycited by 16
  4. 2025Taming Uncertainty via Automation: Observing, Analyzing, and Optimizing Agentic AI Systemscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 19.

21 papers.

Sort:

By area:

  1. 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agentscited by 13
  2. 2025TraceAegis: Securing LLM-Based Agents via Hierarchical and Behavioral Anomaly Detectioncited by 12
  3. 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restorecited by 10
  4. 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agentscited by 10
  5. 2026AgentTrace: A Structured Logging Framework for Agent System Observabilitycited by 9
  6. 2025Agentic Services Computingcited by 6
  7. 2026Towards Security-Auditable LLM Agents: A Unified Graph Representationcited by 6
  8. 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environmentscited by 4
  9. 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 3
  10. 2026In-IDE Toolkit for Developers of AI-Based Featurescited by 0
  11. 2026Signals in the Noise: Open Source Intelligence (OSINT) for AI Loss of Control Detectioncited by 0
  12. 2026Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?cited by 0
9 more
  1. 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agentscited by 0
  2. 2026Autonomy in Check: Governor-Mediated Adaptive Security at the Edgecited by 0
  3. 2026AgentPProf: Semantic Profiler for Long Horizon AI Agentscited by 0
  4. 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
  5. 2026On the Effectiveness of Kernel-Level Evidence for Agent Securitycited by 0
  6. 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?cited by 0
  7. 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agentscited by 0
  8. 2026AgentSpy: Making AI Agent Behavior Observablecited by 0
  9. 2026Kairos: Transactional Security Enforcement at the System Boundary for LLM Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Agentic AI Process Observability: Discovering Behavioral Variability
  2. 2026Cross-Layer Semantic Flow Reconstruction for Attack Detection in Agentic Systems
  3. 2024Watson: A Cognitive Observability Framework for the Reasoning of LLM-Powered Agents
  4. 2026Observability and Fault Injection for LLM-Based Multi-Agent Systems in Software Engineering
  5. 2026Agent Audit: A Security Analysis System for LLM Agent Applications
  6. 2025AgentGuard: Repurposing Agentic Orchestrator for Safety Evaluation of Tool Orchestration
  7. 2026Architectural Obsolescence of Unhardened Agentic-AI Runtimes
  8. 2026Early Diagnosis of Wasted Computation in Multi-Agent LLM Systems via Failure-Aware Observability