L3M: A Verifiable Harness and Runtime for Self-Extending and Self-Improving Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
The lasting gains in AI have come from methods that absorb more computation, and language models already scale computation within a call. Useful work, though, happens across calls: over hours or days, through tools and external systems, among many agents and the humans they work for, and increasingly through code the agents write themselves. Whether that work compounds is enabled by the harness around it, and the harness faces a constraint the model does not: of the three participants in such a computation, the human, the model and code, only the human's attention does not scale, so the computation can grow only if the human is not in every loop. L3M is a runtime built on that premise, written in Lean 4 so that one language implements the harness, states its invariants, and is the language agents extend it in. One computation spans humans, agents, models and code, and all of its state lives in Git: a rich state trajectory -- rather than a chat conversation -- is an object the runtime can resume, rewind, fork, compare and merge. Waiting, communication, delegation and undo are primitives, not patterns the model reasons through each time. When an agent works out a procedure, it can write it once as a sealed Lean program whose type is its permission request, and the harness offers it back as a tool -- machinery for the model to use. To take the human out of the loop, L3M uses reversibility to decide where that is safe: a tool's review tier follows from how far its effects can be undone, so agents act freely where the runtime can recover. Because the machinery can change, the properties that make this safe are stated as kernel-checked theorems about the code that runs. On Terminal-Bench, an untuned L3M reaches about two thirds of its (unsafe) shell-equipped pass rate using only safe (not needing human review) tools.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 63 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
26 of 63 references.
Closest ancestors · 3
Same direction, newest first
- 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agents2 Jun
- 2025Magentic-UI: Towards Human-in-the-loop Agentic Systems30 Jul
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 23
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2018AI safety via debatecited by 400
- 2023Large Language Models as Tool Makerscited by 303
- 2025Defeating Prompt Injections by Designcited by 297
- 2023AI Control: Improving Safety Despite Intentional Subversioncited by 229
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
- 2025Progent: Securing AI Agents with Privilege Controlcited by 141
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 132
- 2025Securing AI Agents with Information-Flow Controlcited by 121
11 more
- 2024AIOS: LLM Agent Operating Systemcited by 97
- 2025The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agentscited by 45
- 2026Dive into Claude Code: The Design Space of Today's and Future AI Agent Systemscited by 38
- 2021Learning to Give Checkable Answers with Prover-Verifier Gamescited by 32
- 2025Avoiding Obfuscation with Prover-Estimator Debatecited by 14
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systemscited by 6
- 2026Toward Securing AI Agents Like Operating Systemscited by 5
- 2026The LLMbda Calculus: AI Agents, Conversations, and Information Flowcited by 4
- 2026Trust but Verify: Prover-Verifier Deliberation for Selective LLM Predictioncited by 4
- 2026Quine: Realizing LLM Agents as Native POSIX Processescited by 2
- 2026Towards an Agent Operating System - Lessons from Classical and Cloud OScited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnesses
- 2026Harnesses for Inference-Time Alignment over Execution Trajectories
- 2026Harnessing LLMs as Agents: What Does It Cost?
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
- 2026How Much Heavy Lifting Can an Agent Harness Do?: Measuring the LLM's Residual Role in a Planning Agent
- 2026AM-Bench: Understanding Agents under Task Underspecification across Models and Harnesses
- 2026Better Harnesses, Smaller Models: Building 90% Cheaper Agents via Automated Harness Adaptation
- 2026Self-Harness: Harnesses That Improve Themselves