CHILL-Harness: Counterfactual Harness Learning for Efficient Reasoning in Long-Horizon Agents
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Agent harnesses have become the operational infrastructure of modern large language model agents, coordinating context, tools, verification, and execution control to translate latent model capability into reliable long-horizon behavior. However, reliable long-horizon behavior requires harness control to adapt to task demands, execution environments, and evolving execution states, whereas current harnesses predominantly rely on hand-crafted or globally fixed policies; this mismatch manifests as unnecessary computational overhead and, in adverse cases, reduced task success. To address this limitation, we formulate the task of enabling adaptive orchestration in harness systems as a causal learning problem and propose Counterfactual Harness Intervention Learning for Long-Horizon Agents (CHILL-Harness). CHILL-Harness intervenes at the orchestration layer to enable advantage-guided workflow adaptation, thereby improving reasoning and execution efficiency while preserving task performance. Specifically, we develop causal intervention effect learning as the effect-estimation component of CHILL-Harness to estimate intervention-relative workflow advantage from confidence-weighted execution evidence and identify advantageous workflow adaptations. We further introduce advantage-realizing causal orchestration as its realization component to adaptively allocate counterfactual reasoning and realize only workflow adjustments supported by sufficient expected advantage. Finally, we incorporate a success-preserving objective and advantage-margin authorization constraints into CHILL-Harness to promote reliable adaptation. Extensive experiments on heterogeneous long-horizon tasks spanning information seeking, software engineering, and terminal interaction show that CHILL-Harness consistently preserves or improves task success while substantially reducing token consumption and execution time.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 10 of its 42 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
10 of 42 references.
References · 10
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 72
- 2026Stop Comparing LLM Agents Without Disclosing the Harnesscited by 25
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2025AWorld: Orchestrating the Training Recipe for Agentic AIcited by 16
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agentscited by 5
- 2026LemonHarness Technical Reportcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents
- 2026Harnesses for Inference-Time Alignment over Execution Trajectories
- 2026Beyond Skill Evolution: Self-Evolving Context Management Policies for Long-Horizon Agent Harnesses
- 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
- 2026Harness-Zero: Harness Distillation via Agent-as-Harness
- 2026Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning
- 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks