Auto: The AGI Compiler
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Every LLM agent run re-derives its behavior token by token on a frontier model: brilliant, expensive, slow, and unbounded. We present Auto, a compiler that records live agent behavior, measures which parts are secretly deterministic, extracts them into verified programs or distilled specialists, and emits cognition binaries: WebAssembly artifacts whose manifests carry measured guarantees and whose declared capabilities are physically enforced by the sandbox. A tiered runtime executes compiled behavior behind conformally calibrated guards; guard trips deopt to the reference agent, and the captured trace recompiles back down, so nothing is figured out twice. We use "AGI compiler" in one narrow, testable sense: a system that autonomously converts novel experience into permanent, verified, near-free skill while measuring what it does not know. On AUTO-BENCH, a benchmark we introduce and pre-register, 87.1% of 560 recorded frontier-agent spans are witnessed-deterministic (three of the four censused task families measure 100.0%). On a 300-item stream with three scheduled distribution shifts, the closed loop compiles three artifact generations and drives marginal cost from 59 to 2 micro-dollars per item (6.4x end-to-end) at 96.9% parity on witnessed inputs with zero errors. The same stream also quantifies the failure modes: a loose guard silently mislabels 48.9% of compiled answers, and an unfaithful deopt reference causes the verification gate to refuse recompilation. Calibration and reference fidelity, not model capability, decide whether cheap stays correct. Code: https://github.com/RightNow-AI/auto
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 25 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
15 of 25 references.
References · 15
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
3 more
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2022Language Model Cascadescited by 104
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026SkillEffect: Checked Lowering for Memory-Bounded Agent Tools17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Automata from Agent Traces: Failure and Next-Step Prediction
- 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflows
- 2026TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces
- 2026BekchiAI: Measuring, Observing, and Controlling LLM Agents in One Click
- 2025Agint: Agentic Graph Compilation for Software Engineering Agents
- 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents
- 2026Your Agent Has a Genome: Sequence-Level Behavioral Analysis and Runtime Governance of LLM-Powered Autonomous Agents
- 2026Getting Better at Working With You: Compiling User Corrections into Runtime Enforcement for Coding Agents