Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
Not on the map. Why?
Abstract (arXiv)
Search agents are often trained as policies over growing transcripts: the model must decide how to search while also remembering what it has seen, which evidence is useful, which constraints remain open, and which claims have actually been checked. We argue that this formulation puts too much routine state management inside the policy: reinforcement learning is forced to optimize both semantic search decisions and recoverable bookkeeping that the environment can maintain more reliably. We introduce Harness-1, a 20B search agent (retrieval subagent) trained with reinforcement learning inside a stateful search harness. The harness maintains environment-side working memory, including a candidate pool, an importance-tagged curated set, compact evidence links, verification records, compressed and deduplicated observations, and budget-aware context rendering. The policy retains the semantic decisions: what to search, which documents to keep or discard, what to verify, and when to stop. Across eight retrieval benchmarks spanning web, finance, patents, and multi-hop QA, Harness-1 achieves 0.730 average curated recall, outperforming the next strongest open search subagent by +11.4 points and remaining competitive with much larger frontier-model searchers. Its gains are especially strong on held-out transfer benchmarks, suggesting that reinforcement learning over explicit search state can produce retrieval behaviors that generalize beyond the training domains. Our code is available at https://github.com/pat-jj/harness-1.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jun 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansioncited by 3
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agentscited by 1
- 2026Harness-G: A Graph-Structured Harness for Search Agentscited by 0
- 2026Fetch-then-Explore: Decoupling Selection from Extraction over a Persistent Workspace for Search Agentscited by 0
- 2026Self-Correcting Long-Horizon Search Agents via Tree-Structured Memorycited by 0
- 2026Harness Annealing: Learning to Act with Less External Controlcited by 0
- 2026Harness Annealing: Learning to Act with Less External Control1 Oct 2026
- 2026Self-Correcting Long-Horizon Search Agents via Tree-Structured Memory11 Aug 2026
- 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents5 Aug 2026
- 2026Fetch-then-Explore: Decoupling Selection from Extraction over a Persistent Workspace for Search Agents3 Aug 2026
- 2026Harness-G: A Graph-Structured Harness for Search Agents30 Jul 2026
- 2026Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion12 Jun 2026