mlsanityData to 14 Oct 2026

AutoFyn Technical Report: Non-Parametric Expert Iteration for Long-Horizon Agents

arXiv 2609.05446 ↗First posted 31 Jul 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce AutoFyn, an agent harness inspired by the Expert Iteration algorithm, adapting a frozen model across many rounds by updating persistent state from verified reward signals rather than model weights. Each round begins from a fresh model session, and durable information is reintroduced only through explicit interfaces such as persistent memory files, reports, and repository state. Within a round, an orchestrator explores, plans and builds many alternative approaches with specialized agents, while a task-grounded verifier verifies the work and supplies an objective reward for measuring progress. This reward is distilled back into the persistent state, which updates the effective policy for the next round. In this technical report, we formalize this loop and describe its persistent state and verification interfaces. We then demonstrate its use in three domains, namely olympiad mathematics, data science, and cybersecurity. On the six fresh problems of the 2026 International Mathematical Olympiad, every model with room to improve scores higher under AutoFyn than in its provider's own coding agent. AutoFyn also built the top-ranked agent on the Spider 2.0 dbt benchmark, and has produced 16 maintainer-confirmed vulnerability advisories in Next.js, MetaMask, pnpm, Warp, LiteLLM, Langflow, and Open WebUI.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

16 of 20 references.

References · 16

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  8. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  9. 2017Thinking Fast and Slow with Deep Learning and Tree Searchcited by 252
  10. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
  11. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
  12. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
4 more
  1. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
  2. 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflowscited by 57
  3. 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 43
  4. 2023Large Language Models Are Semi-Parametric Reinforcement Learning Agentscited by 42

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify
  2. 2026AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
  3. 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards
  4. 2026RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Models
  5. 2025From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
  6. 2026AutoScientist-Quant: Self-Evolving Coding Agents for Automatic Research in Quantitative Investment
  7. 2025AutoMind: Adaptive Knowledgeable Agent for Automated Data Science
  8. 2026EPOCH: Reliable Discovery through Evidence-Governed Search