mlsanityData to 14 Oct 2026

Auditing Harness Tampering in Self-Improving Agents

arXiv 2609.00069 ↗First posted 30 Aug 2026cs.CL cs.AIcited by 4

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Self-improving agents iteratively modify their own harness to push the frontier of their performance. However, such modifications can produce illusory performance gains or compromise integrity constraints such as authorization, provenance, and completeness without genuinely improving capability. We term this phenomenon as harness tampering, which extends the concept from reward and measurement tampering to the full self-improvement lifecycle. To systematically study this problem, we propose a two-axis taxonomy that categorizes each misaligned edit by the harness functional role in which it occurs and the obligation it violates. Then we build an annotated corpus by seeding tampered-benign edit pairs into the real trajectories of self-improving agents. We adapt and benchmark diverse audit methods on tampering classification and localization tasks. Finally we systematically audit real trajectories of self-improving agents. The results demonstrate that harness tampering consistently occurs in real runs from different agents, often persists in the lineage of the best agent, and forms distinct system-specific profiles across the taxonomy.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 28 of its 44 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

28 of 44 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul
  2. 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May
  3. 2026On Safety Risks in Experience-Driven Self-Evolving Agents18 Apr
  4. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents30 Sep
  5. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug

Other references · 23

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  2. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  3. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  4. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  5. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  6. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  7. 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 178
  8. 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 108
  9. 2026Self-Harness: Harnesses That Improve Themselvescited by 107
  10. 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 71
  11. 2026Rethinking the Evaluation of Harness Evolution for Agentscited by 48
  12. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 46
11 more
  1. 2026Reward Hacking Benchmark: Measuring Exploits in LLM Agents with Tool Usecited by 31
  2. 2026SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agentscited by 28
  3. 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidencecited by 19
  4. 2026Benchmarking Reward Hack Detection in Code Environments via Contrastive Analysiscited by 18
  5. 2026BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarkscited by 15
  6. 2026Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJackcited by 14
  7. 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 14
  8. 2026Harness-Aware Self-Evolving: Co-Evolving Model Weights, Harness, and Task Solutionscited by 12
  9. 2026Counterfactual Trace Auditing of LLM Agent Skillscited by 10
  10. 2026Hack-Verifiable Environments: Towards Evaluating Reward Hacking at Scalecited by 10
  11. 2026Distributed Attacks in Persistent-State AI Controlcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement
  2. 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses
  3. 2026Self-Authored Verification Is Unreliable in Heuristic Self-Improving Agents
  4. 2026Phantom Guardrails: When Self-Improving Agent Harnesses Fix Failures That Never Happened
  5. 2026Auditing Agent Harness Safety
  6. 2026Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes
  7. 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
  8. 2026Harness^2: Recursive Agent Harnessing for an Open World