Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring
Not on the map. Why?
Abstract (arXiv)
Self-evolving agent harnesses continually update persistent components such as memory, prompts, skills, and tools. We call this process harness evolution. However, such evolution could introduce unexpected safety risks. Existing work studies harness misevolution and validates candidate harnesses or attributed individual component updates, leaving safety analysis of cross-component update interactions largely unexamined. To address this gap, we study compositional safety failures in harness evolution, where interactions among individually safe and utility-preserving component updates can produce undesirable or unsafe agent behavior, revealing a safety risk intrinsic to harness evolution. Across three safety-related benchmarks, we identify 43 pairwise and 18 irreducible 3-way compositional safety failures. Conventional solution incurs combinatorial complexity in validating cross-component interactions, leaving the safety checking impractical as the harness evolves. To solve this, we introduced a typed hypergraph that represents component states as nodes and safety-relevant higher-order interactions as hyperedges. When the harness changes, the hypergraph updates only the interaction neighborhood of the changed states rather than reconstructing the global composition space. Building on that, we develop a hypergraph-guided runtime monitoring mechanism. Experiments show that our method effectively mitigates compositional safety risks while preserving task utility and reducing interaction-checking costs, and further reveal an empirical safety-utility-cost trade-off across different safety mechanisms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
33 of 42 references.
References · 33
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 369
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 306
- 2023Tool Learning with Foundation Modelscited by 302
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
21 more
- 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
- 2026Self-Harness: Harnesses That Improve Themselvescited by 107
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 62
- 2026Natural-Language Agent Harnessescited by 61
- 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injectionscited by 48
- 2024Learning Evolving Tools for Large Language Modelscited by 16
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 16
- 2026TTHE: Test-Time Harness Evolutioncited by 16
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 15
- 2026On Safety Risks in Experience-Driven Self-Evolving Agentscited by 14
- 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiencescited by 14
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolutioncited by 12
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studiescited by 8
- 2026Verify Smarter, Evolve Further: Efficient Harness Evolution through Behavior-Aware Verificationcited by 7
- 2026SkillJack: Persistent Skill Backdoors in Self-Evolving Agentscited by 6
- 2026SHE: Trajectory-driven Safety Harness Evolution for LLM Agentscited by 6
- 2026SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety Alignmentcited by 6
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agentscited by 5
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026Benign Alone, Harmful Together: Exploiting Experience Composition in Self-Evolving LLM Agentscited by 2
Built on by
Not cited yet.