AgentSight: System-Level Observability for AI Agents Using eBPF
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Modern software infrastructure increasingly relies on LLM agents for development and maintenance, such as Claude Code and Gemini-cli. However, these AI agents differ fundamentally from traditional deterministic software, posing a significant challenge to conventional monitoring and debugging. This creates a critical semantic gap: existing tools observe either an agent's high-level intent (via LLM prompts) or its low-level actions (e.g., system calls), but cannot correlate these two views. This blindness makes it difficult to distinguish between benign operations, malicious attacks, and costly failures. We introduce AgentSight, an AgentOps observability framework that bridges this semantic gap using a hybrid approach. Our approach, boundary tracing, monitors agents from outside their application code at stable system interfaces using eBPF. AgentSight intercepts TLS-encrypted LLM traffic to extract semantic intent, monitors kernel events to observe system-wide effects, and causally correlates these two streams across process boundaries using a real-time engine and secondary LLM analysis. This instrumentation-free technique is framework-agnostic, resilient to rapid API changes, and incurs less than 3% performance overhead. Our evaluation shows AgentSight detects prompt injection attacks, identifies resource-wasting reasoning loops, and reveals hidden coordination bottlenecks in multi-agent systems. AgentSight is released as an open-source project at https://github.com/agent-sight/agentsight.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 5 of its 23 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
5 of 23 references.
Closest ancestors · 1
Same direction, newest first
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 4
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2024AgentOps: Enabling Observability of LLM Agentscited by 46
- 2025Because we have LLMs, we Can and Should Pursue Agentic Interpretabilitycited by 16
- 2025Taming Uncertainty via Automation: Observing, Analyzing, and Optimizing Agentic AI Systemscited by 12
Built on by
Citing papers per year: 2025: 2; 2026: 19.
21 papers.
Sort:
By area:
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agentscited by 13
- 2025TraceAegis: Securing LLM-Based Agents via Hierarchical and Behavioral Anomaly Detectioncited by 12
- 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restorecited by 10
- 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agentscited by 10
- 2026AgentTrace: A Structured Logging Framework for Agent System Observabilitycited by 9
- 2025Agentic Services Computingcited by 6
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representationcited by 6
- 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environmentscited by 4
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 3
- 2026In-IDE Toolkit for Developers of AI-Based Featurescited by 0
- 2026Signals in the Noise: Open Source Intelligence (OSINT) for AI Loss of Control Detectioncited by 0
- 2026Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?cited by 0
9 more
- 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agentscited by 0
- 2026Autonomy in Check: Governor-Mediated Adaptive Security at the Edgecited by 0
- 2026AgentPProf: Semantic Profiler for Long Horizon AI Agentscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026On the Effectiveness of Kernel-Level Evidence for Agent Securitycited by 0
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?cited by 0
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agentscited by 0
- 2026AgentSpy: Making AI Agent Behavior Observablecited by 0
- 2026Kairos: Transactional Security Enforcement at the System Boundary for LLM Agentscited by 0
- 2026Kairos: Transactional Security Enforcement at the System Boundary for LLM Agents13 Oct 2026
- 2026AgentSpy: Making AI Agent Behavior Observable5 Oct 2026
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents1 Oct 2026
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?26 Sep 2026
- 2026On the Effectiveness of Kernel-Level Evidence for Agent Security24 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Autonomy in Check: Governor-Mediated Adaptive Security at the Edge16 Sep 2026
- 2026AgentPProf: Semantic Profiler for Long Horizon AI Agents14 Sep 2026
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agents21 Jul 2026
- 2026Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?20 Jul 2026
- 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agents2 Jun 2026
9 more
- 2026Signals in the Noise: Open Source Intelligence (OSINT) for AI Loss of Control Detection22 May 2026
- 2026In-IDE Toolkit for Developers of AI-Based Features14 May 2026
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representation7 May 2026
- 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environments6 Apr 2026
- 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restore21 Mar 2026
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents10 Feb 2026
- 2026AgentTrace: A Structured Logging Framework for Agent System Observability7 Feb 2026
- 2025TraceAegis: Securing LLM-Based Agents via Hierarchical and Behavioral Anomaly Detection13 Oct 2025
- 2025Agentic Services Computing29 Sep 2025
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agentscited by 13
- 2025TraceAegis: Securing LLM-Based Agents via Hierarchical and Behavioral Anomaly Detectioncited by 12
- 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restorecited by 10
- 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agentscited by 10
- 2026AgentTrace: A Structured Logging Framework for Agent System Observabilitycited by 9
- 2025Agentic Services Computingcited by 6
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representationcited by 6
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 3
- 2026In-IDE Toolkit for Developers of AI-Based Featurescited by 0
- 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agentscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026On the Effectiveness of Kernel-Level Evidence for Agent Securitycited by 0
12 most cited of 14 All 14 (JSON)
- 2026Kairos: Transactional Security Enforcement at the System Boundary for LLM Agents13 Oct 2026
- 2026AgentSpy: Making AI Agent Behavior Observable5 Oct 2026
- 2026On the Effectiveness of Kernel-Level Evidence for Agent Security24 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agents21 Jul 2026
- 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agents2 Jun 2026
- 2026In-IDE Toolkit for Developers of AI-Based Features14 May 2026
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representation7 May 2026
- 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restore21 Mar 2026
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents10 Feb 2026
- 2026AgentTrace: A Structured Logging Framework for Agent System Observability7 Feb 2026
12 newest of 14 All 14 (JSON)
- 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environmentscited by 4
- 2026Signals in the Noise: Open Source Intelligence (OSINT) for AI Loss of Control Detectioncited by 0
- 2026Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?cited by 0
- 2026Autonomy in Check: Governor-Mediated Adaptive Security at the Edgecited by 0
- 2026AgentPProf: Semantic Profiler for Long Horizon AI Agentscited by 0
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?cited by 0
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agentscited by 0
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents1 Oct 2026
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?26 Sep 2026
- 2026Autonomy in Check: Governor-Mediated Adaptive Security at the Edge16 Sep 2026
- 2026AgentPProf: Semantic Profiler for Long Horizon AI Agents14 Sep 2026
- 2026Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?20 Jul 2026
- 2026Signals in the Noise: Open Source Intelligence (OSINT) for AI Loss of Control Detection22 May 2026
- 2026AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environments6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Agentic AI Process Observability: Discovering Behavioral Variability
- 2026Cross-Layer Semantic Flow Reconstruction for Attack Detection in Agentic Systems
- 2024Watson: A Cognitive Observability Framework for the Reasoning of LLM-Powered Agents
- 2026Observability and Fault Injection for LLM-Based Multi-Agent Systems in Software Engineering
- 2026Agent Audit: A Security Analysis System for LLM Agent Applications
- 2025AgentGuard: Repurposing Agentic Orchestrator for Safety Evaluation of Tool Orchestration
- 2026Architectural Obsolescence of Unhardened Agentic-AI Runtimes
- 2026Early Diagnosis of Wasted Computation in Multi-Agent LLM Systems via Failure-Aware Observability