mlsanityData to 7 Oct 2026

Forgotten in Weights, Recovered by Tools: Agentic Tool Unlearning for LLM Agents

arXiv 2608.21544 ↗First posted 21 Aug 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Tool learning and function calling

also in 1 more
Abstract (arXiv)

Large language models (LLMs) are increasingly deployed as tool-augmented agents, where responses can depend on tool calls and external observations rather than model parameters alone. This creates an evaluation mismatch for LLM unlearning: previous unlearning methods may suppress direct parametric recall, but an agent can still recover the same forget target through tools such as web search, retrieval, or database lookup. We identify this failure mode as tool-mediated recovery and study agentic tool unlearning, which aims to reduce both parametric recall and tool-mediated recovery while preserving normal tool use for retained knowledge. To address this challenge, we propose Agentic Tool Unlearning (ATU), a two-stage framework. The first stage applies parametric knowledge unlearning to suppress direct recall, while the second stage performs trajectory-level reinforcement learning in simulated tool-augmented environments to penalize target-seeking tool behavior and final-answer leakage. Experiments on RWKU and MUSE across different LLM architectures show that ATU achieves a better balance between target forgetting and retained utility, making unlearning more robust under tool-augmented agent deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 21 of its 35 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

21 of 35 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Tool Unlearning for Tool-Augmented LLMs3 Feb
  2. 2023Gorilla: Large Language Model Connected with Massive APIs24 May
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb

Other references · 18

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2019Machine Unlearningcited by 1,020
  5. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
  6. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  7. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
  8. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 424
  9. 2023Who's Harry Potter? Approximate Unlearning in LLMscited by 366
  10. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
  11. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearningcited by 160
  12. 2025Multi-Agent Risks from Advanced AIcited by 150
6 more
  1. 2024Towards Safer Large Language Models through Machine Unlearningcited by 134
  2. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
  3. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
  4. 2024Machine Unlearning in Generative AI: A Surveycited by 49
  5. 2025Nuclear Deployed: Analyzing Catastrophic Risks in Decision-making of Autonomous LLM Agentscited by 23
  6. 2026Agentic Unlearning: When LLM Agent Meets Machine Unlearningcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agents
  2. 2026K-Bench: A Benchmark for LLM Unlearning in Agentic Deployments
  3. 2025Agents Are All You Need for LLM Unlearning
  4. 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory
  5. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skills
  6. 2026Trajectory Unlearning on LLM-based Agents
  7. 2026When Not to Imitate: Boundary-Aware Skill Memory for Reliable Tool-Use LLM Agents
  8. 2026Toolcompass: Guiding Tool Trialing, Not Suppressing It