mlsanityData to 7 Oct 2026

LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search

arXiv 2605.09764 ↗First posted 10 May 2026cs.NE cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

LLM-guided evolutionary methods such as AlphaEvolve have proven effective in domains like math, systems research, and algorithmic discovery, but their reliance on frontier models makes each run expensive. We argue this is largely an artifact of how existing frameworks allocate search: archives that fail to preserve solution diversity force compensation through stronger mutation models; blind model use spends frontier dollars on local edits a smaller model could handle; and full-set evaluation wastes rollouts on redundant examples. We introduce LEVI, a harness-first evolutionary framework built on the bet that stronger search architectures can substitute for or even outperform larger LLMs in evolutionary search. LEVI improves on three core components of evolutionary search: a solution database that establishes diversity from the beginning, and then maintains it throughout the run; a smarter mutation router that plays into the strengths of large and small LLMs; and a rank-preserving proxy benchmark for rollout-heavy settings. Across systems-research benchmarks LEVI attains the highest score on a budget 3.3-6.7x smaller than the published frontier-model runs of existing frameworks like ShinkaEvolve, GEPA, and AdaEvolve; on one problem, LEVI matches the existing best at a 35x lower cost. On prompt optimization, LEVI matches or exceeds GEPA at less than half of its rollout budget on four different benchmarks. LEVI is available as an open-source framework at https://github.com/ttanv/levi.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

14 of 24 references.

References · 14

  1. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  2. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  3. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  4. 2015Illuminating search spaces by mapping elitescited by 406
  5. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
  6. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  7. 2025Generalizing Verifiable Instruction Followingcited by 178
  8. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
  9. 2025Mathematical exploration and discovery at scalecited by 66
  10. 2016Using Centroidal Voronoi Tessellations to Scale Up the Multi-dimensional Archive of Phenotypic Elites Algorithmcited by 65
  11. 2024PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensemblescited by 54
  12. 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
2 more
  1. 2025FrontierCS: Evolving Challenges for Evolving Intelligencecited by 19
  2. 2025Adaptive Kernel Design for Bayesian Optimization Is a Piece of CAKE with LLMscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.