LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search
Not on the map. Why?
Abstract (arXiv)
LLM-guided evolutionary methods such as AlphaEvolve have proven effective in domains like math, systems research, and algorithmic discovery, but their reliance on frontier models makes each run expensive. We argue this is largely an artifact of how existing frameworks allocate search: archives that fail to preserve solution diversity force compensation through stronger mutation models; blind model use spends frontier dollars on local edits a smaller model could handle; and full-set evaluation wastes rollouts on redundant examples. We introduce LEVI, a harness-first evolutionary framework built on the bet that stronger search architectures can substitute for or even outperform larger LLMs in evolutionary search. LEVI improves on three core components of evolutionary search: a solution database that establishes diversity from the beginning, and then maintains it throughout the run; a smarter mutation router that plays into the strengths of large and small LLMs; and a rank-preserving proxy benchmark for rollout-heavy settings. Across systems-research benchmarks LEVI attains the highest score on a budget 3.3-6.7x smaller than the published frontier-model runs of existing frameworks like ShinkaEvolve, GEPA, and AdaEvolve; on one problem, LEVI matches the existing best at a 35x lower cost. On prompt optimization, LEVI matches or exceeds GEPA at less than half of its rollout budget on four different benchmarks. LEVI is available as an open-source framework at https://github.com/ttanv/levi.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
14 of 24 references.
References · 14
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2015Illuminating search spaces by mapping elitescited by 406
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2025Generalizing Verifiable Instruction Followingcited by 178
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2025Mathematical exploration and discovery at scalecited by 66
- 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 65
- 2024PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensemblescited by 54
- 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
2 more
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 25
- 2026Automated Discovery Has No Universally Superior Harnesscited by 4
- 2026Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven Evolutioncited by 1
- 2026Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressorscited by 0
- 2026Optimize Cheap, Deploy Strong: Cost-Aware Cross-Tier Transfer for Evolutionary Optimizationcited by 0
- 2026Optimize Cheap, Deploy Strong: Cost-Aware Cross-Tier Transfer for Evolutionary Optimization11 Aug 2026
- 2026Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven Evolution6 Aug 2026
- 2026Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors28 Jul 2026
- 2026Automated Discovery Has No Universally Superior Harness20 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026