On Protecting Agentic Systems' Intellectual Property via Watermarking
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
The evolution of Large Language Models (LLMs) into agentic systems that perform autonomous reasoning and tool use has created significant intellectual property (IP) value. We demonstrate that these systems are highly vulnerable to imitation attacks, where adversaries steal proprietary capabilities by training imitation models on victim outputs. Crucially, existing LLM watermarking techniques fail in this domain because real-world agentic systems often operate as grey boxes, concealing the internal reasoning traces required for verification. This paper presents AGENTWM, the first watermarking framework designed specifically for agentic models. AGENTWM exploits the semantic equivalence of action sequences, injecting watermarks by subtly biasing the distribution of functionally identical tool execution paths. This mechanism allows AGENTWM to embed verifiable signals directly into the visible action trajectory while remaining indistinguishable to users. We develop an automated pipeline to generate robust watermark schemes and a rigorous statistical hypothesis testing procedure for verification. Extensive evaluations across three complex domains demonstrate that AGENTWM achieves high detection accuracy with negligible impact on agent performance. Our results confirm that AGENTWM effectively protects agentic IP against adaptive adversaries, who cannot remove the watermarks without severely degrading the stolen model's utility.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 54 of its 73 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
54 of 73 references.
Closest ancestors · 4
Same direction, newest first
- 2025CoTGuard: Using Chain-of-Thought Triggering for Copyright Protection in Multi-Agent LLM Systems26 May
- 2025IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems18 May
- 2025Agent Guide: A Simple Agent Behavioral Watermarking Framework8 Apr
- 2025Les Dissonances: Cross-Tool Harvesting and Polluting in Pool-of-Tools Empowered LLM Agents4 Apr
Other references · 50
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020Extracting Training Data from Large Language Modelscited by 2,144
38 more
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023LIMA: Less Is More for Alignmentcited by 1,080
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2023A Watermark for Large Language Modelscited by 667
- 2025LIMO: Less is More for Reasoningcited by 488
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
- 2024Stealing Part of a Production Language Modelcited by 152
- 2024Tree Search for Language Model Agentscited by 148
- 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 99
- 2023A Semantic Invariant Robust Watermark for Large Language Modelscited by 97
- 2018Exploring Connections Between Active Learning and Model Extractioncited by 84
- 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
- 2025Efficient Reasoning with Hidden Thinkingcited by 72
- 2022CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarkscited by 68
- 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 64
- 2024Instructional Fingerprinting of Large Language Modelscited by 64
- 2024Adaptive Text Watermark for Large Language Modelscited by 60
- 2023Towards Codable Watermarking for Injecting Multi-bits Information to LLMscited by 43
- 2024DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflowscited by 43
- 2025Distilling LLM Agent into Small Models with Retrieval and Code Toolscited by 41
- 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
- 2024ACPBench: Reasoning about Action, Change, and Planningcited by 37
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attributioncited by 35
- 2024GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trickcited by 31
- 2024Enhancing Decision-Making for LLM Agents via Step-Level Q-Value Modelscited by 28
- 2025A Survey on Model Extraction Attacks and Defenses for Large Language Modelscited by 18
- 2025Intrinsic Fingerprint of LLMs: Continue Training is NOT All You Need to Steal A Model!cited by 16
- 2024Evaluating LLM-based Personal Information Extraction and Countermeasurescited by 12
- 2024PRSA: Prompt Stealing Attacks against Real-World Prompt Servicescited by 9
- 2025Differentiation-Based Extraction of Proprietary Data from Fine-Tuned LLMscited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systemscited by 12
- 2026Sequential Behavioral Watermarking for LLM Agentscited by 3
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectoriescited by 3
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protectioncited by 2
- 2026AgentProv: Auditing Agentic LLM API Providers via Tool-use Policy Probescited by 0
- 2026TrajMark: Ownership Attribution and Segment-Level Tamper Localization for Coding-Agent Trajectoriescited by 0
- 2026Who Is Behind the Harness? Fingerprinting LLMs through Agentic Behaviorcited by 0
- 2026Who Is Behind the Harness? Fingerprinting LLMs through Agentic Behavior23 Sep 2026
- 2026TrajMark: Ownership Attribution and Segment-Level Tamper Localization for Coding-Agent Trajectories9 Sep 2026
- 2026AgentProv: Auditing Agentic LLM API Providers via Tool-use Policy Probes30 Aug 2026
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories9 Jul 2026
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protection9 Jun 2026
- 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systems24 May 2026
- 2026Sequential Behavioral Watermarking for LLM Agents11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Semantic Behavioral Watermarking: Paraphrase-Robust and Forgery-Resistant Provenance for LLM Agents
- 2026AgentMark: Utility-Preserving Behavioral Watermarking for Agents
- 2026From Secure Agentic AI to Secure Agentic Web: Challenges, Threats, and Future Directions
- 2026Watermarking Game-Playing Agents in Perfect-Information Extensive-Form Games
- 2026Black-Box Skill Stealing Attack from Proprietary LLM Agents: An Empirical Study
- 2025SIEVE: Selective Integrity Verification and Escalation for Defending LLM Agents against Indirect Prompt Injection
- 2024Agentic Copyright Watermarking against Adversarial Evidence Forgery with Purification-Agnostic Curriculum Proxy Learning
- 2026AgentSecBench: Measuring Prompt Injection, Privacy Leakage, and Tool-Use Integrity in LLM Agents