mlsanityData to 14 Oct 2026

Agent Guide: A Simple Agent Behavioral Watermarking Framework

arXiv 2504.05871 ↗First posted 8 Apr 2025cs.AIcited by 10

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

The increasing deployment of intelligent agents in digital ecosystems, such as social media platforms, has raised significant concerns about traceability and accountability, particularly in cybersecurity and digital content protection. Traditional large language model (LLM) watermarking techniques, which rely on token-level manipulations, are ill-suited for agents due to the challenges of behavior tokenization and information loss during behavior-to-action translation. To address these issues, we propose Agent Guide, a novel behavioral watermarking framework that embeds watermarks by guiding the agent's high-level decisions (behavior) through probability biases, while preserving the naturalness of specific executions (action). Our approach decouples agent behavior into two levels, behavior (e.g., choosing to bookmark) and action (e.g., bookmarking with specific tags), and applies watermark-guided biases to the behavior probability distribution. We employ a z-statistic-based statistical analysis to detect the watermark, ensuring reliable extraction over multiple rounds. Experiments in a social media scenario with diverse agent profiles demonstrate that Agent Guide achieves effective watermark detection with a low false positive rate. Our framework provides a practical and robust solution for agent watermarking, with applications in identifying malicious agents and protecting proprietary agent systems.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 19 of its 28 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

19 of 28 references.

References · 19

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  6. 2023A Watermark for Large Language Modelscited by 725
  7. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 233
  8. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
  9. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
  10. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 158
  11. 2023User Behavior Simulation with Large Language Model based Agentscited by 140
  12. 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
7 more
  1. 2024MarkLLM: An Open-Source Toolkit for LLM Watermarkingcited by 95
  2. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 71
  3. 2023Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermarkcited by 67
  4. 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 54
  5. 2024CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Codecited by 24
  6. 2024Waterfall: Framework for Robust and Scalable Text Watermarking and Provenance for LLMscited by 15
  7. 2019Behavioral Security in Covert Communication Systemscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillMarker: A KGW-Based Watermarking Method for Agent Skill Ownership Verification
  2. 2026Watermarking LLM Agent Trajectories
  3. 2026Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
  4. 2026TrajMark: Ownership Attribution and Segment-Level Tamper Localization for Coding-Agent Trajectories
  5. 2026Watermarking Game-Playing Agents in Perfect-Information Extensive-Form Games
  6. 2026Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking
  7. 2026TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces
  8. 2026From Forensics to Ecosystems: Rethinking Watermarks for Generative AI Oversight