Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
LLM agents are shaped not only by their language models, but also by the runtime harness that mediates observation, tool use, action execution, feedback interpretation, and trajectory control. While existing agent adaptation methods mainly update model parameters, many failures in deterministic, rule-governed domains stem from mismatches at the model--environment interface. We propose Life-Harness, a lifecycle-aware runtime harness that improves frozen LLM agents without changing model weights or evaluation environments. Life-Harness evolves from training trajectories by converting recurring interaction failures into reusable interventions across environment contracts, procedural skills, action realization, and trajectory regulation, and remains fixed for evaluation on unseen tasks. We evaluate Life-Harness across eight environments from AgentBench, τ-bench, τ2-bench, and AppWorld using 18 open-weight backbones, and further test three frontier models on seven environments. With Qwen3-4B-Instruct, Life-Harness exceeds Meta-Harness and AHE by 28.7 and 7.5 percentage points in mean accuracy across the seven shared environments, respectively, while using 8.5% and 68.4% fewer optimization tokens. The evolved harnesses also benefit GPT 5.5, Opus 4.8, and Gemini 3.1 Pro, yielding an average accuracy gain of 3.5 percentage points. Code is available at https://github.com/Tianshi-Xu/Life-Harness.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 32 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
22 of 32 references.
Closest ancestors · 3
Same direction, newest first
- 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agents11 May
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr
- 2024Executable Code Actions Elicit Better LLM Agents1 Feb
Other references · 19
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
7 more
- 2023FireAct: Toward Language Agent Fine-tuningcited by 256
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 167
- 2025Distilling LLM Agent into Small Models with Retrieval and Code Toolscited by 47
- 2024PromptWizard: Task-Aware Prompt Optimization Frameworkcited by 36
- 2026Learning to Continually Learn via Meta-learning Agentic Memory Designscited by 18
- 2026Workspace Optimization: How to Train Your Agentcited by 7
- 2026CLEANER: Self-Purified Trajectories Boost Agentic Reinforcement Learningcited by 4
Built on by
Citing papers per year: 2026: 27.
27 papers.
Sort:
By area:
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 20
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 16
- 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 14
- 2026Better Harnesses, Smaller Models: Building 90% Cheaper Agents via Automated Harness Adaptationcited by 7
- 2026Phantom Guardrails: When Self-Improving Agent Harnesses Fix Failures That Never Happenedcited by 7
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnessescited by 7
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Failscited by 4
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agentscited by 3
- 2026LemonHarness Technical Reportcited by 2
- 2026Self-Evolving Coding Agentscited by 2
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safetycited by 2
15 more
- 2026EvoOntology: A Self-Evolving Ontology Layer for Data Agentscited by 2
- 2026Think-Before-Speak: From Internal Evaluation to Public Expression in Multi-Agent Social Simulationcited by 1
- 2026Measuring Harness-Induced Belief Divergence in Multi-Step LLM Agentscited by 1
- 2026Agent Harness Distillation: Inference-Time Harness Extraction and Exploitation in Autonomous Multi-Agent Systemscited by 1
- 2026StateM: Reaching 95.3% Raw Accuracy, or a 15 Frontier Run, on Terminal-Bench 2.1 via Harness Scalingcited by 1
- 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
- 2026STAGE: Stateful Translation to Agentic Graph Execution with Policy-Scoped Context and Deterministic Controlcited by 0
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agentscited by 0
- 2026Harness Engineering for Predictable Agentic Systems: An Empirical Study of Deterministic Execution Constraintscited by 0
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Timecited by 0
- 2026SHarP: Saliency-based Pruning of Agent Harnessescited by 0
- 2026FreeEvolve: Learning to Evolve Beyond Fixed Loopscited by 0
- 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learningcited by 0
- 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agentscited by 0
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systemscited by 0
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems10 Oct 2026
- 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agents8 Oct 2026
- 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learning8 Oct 2026
- 2026FreeEvolve: Learning to Evolve Beyond Fixed Loops6 Oct 2026
- 2026SHarP: Saliency-based Pruning of Agent Harnesses3 Oct 2026
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time2 Oct 2026
- 2026EvoOntology: A Self-Evolving Ontology Layer for Data Agents14 Sep 2026
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents10 Sep 2026
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails8 Sep 2026
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
- 2026Harness Engineering for Predictable Agentic Systems: An Empirical Study of Deterministic Execution Constraints25 Aug 2026
- 2026STAGE: Stateful Translation to Agentic Graph Execution with Policy-Scoped Context and Deterministic Control23 Aug 2026
15 more
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety18 Aug 2026
- 2026StateM: Reaching 95.3% Raw Accuracy, or a 15 Frontier Run, on Terminal-Bench 2.1 via Harness Scaling15 Aug 2026
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses9 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectories3 Aug 2026
- 2026Agent Harness Distillation: Inference-Time Harness Extraction and Exploitation in Autonomous Multi-Agent Systems30 Jul 2026
- 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolution15 Jul 2026
- 2026Phantom Guardrails: When Self-Improving Agent Harnesses Fix Failures That Never Happened13 Jul 2026
- 2026Better Harnesses, Smaller Models: Building 90% Cheaper Agents via Automated Harness Adaptation9 Jul 2026
- 2026Measuring Harness-Induced Belief Divergence in Multi-Step LLM Agents5 Jul 2026
- 2026LemonHarness Technical Report23 Jun 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun 2026
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry12 Jun 2026
- 2026Think-Before-Speak: From Internal Evaluation to Public Expression in Multi-Agent Social Simulation2 Jun 2026
- 2026MUSE: A Unified Agentic Harness for MLLMs2 Jun 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 20
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 16
- 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 14
- 2026Better Harnesses, Smaller Models: Building 90% Cheaper Agents via Automated Harness Adaptationcited by 7
- 2026Phantom Guardrails: When Self-Improving Agent Harnesses Fix Failures That Never Happenedcited by 7
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnessescited by 7
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Failscited by 4
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agentscited by 3
- 2026Self-Evolving Coding Agentscited by 2
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safetycited by 2
- 2026EvoOntology: A Self-Evolving Ontology Layer for Data Agentscited by 2
- 2026Measuring Harness-Induced Belief Divergence in Multi-Step LLM Agentscited by 1
12 most cited of 21 All 21 (JSON)
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems10 Oct 2026
- 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learning8 Oct 2026
- 2026FreeEvolve: Learning to Evolve Beyond Fixed Loops6 Oct 2026
- 2026SHarP: Saliency-based Pruning of Agent Harnesses3 Oct 2026
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time2 Oct 2026
- 2026EvoOntology: A Self-Evolving Ontology Layer for Data Agents14 Sep 2026
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents10 Sep 2026
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails8 Sep 2026
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
- 2026Harness Engineering for Predictable Agentic Systems: An Empirical Study of Deterministic Execution Constraints25 Aug 2026
- 2026STAGE: Stateful Translation to Agentic Graph Execution with Policy-Scoped Context and Deterministic Control23 Aug 2026
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety18 Aug 2026
12 newest of 21 All 21 (JSON)
- 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
- 2026MUSE: A Unified Agentic Harness for MLLMs2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents
- 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
- 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses
- 2026Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
- 2026Self-Harness: Harnesses That Improve Themselves
- 2026TTHE: Test-Time Harness Evolution
- 2026Beyond Skill Evolution: Self-Evolving Context Management Policies for Long-Horizon Agent Harnesses
- 2026Harness-Zero: Harness Distillation via Agent-as-Harness