Towards Certificate-Driven Software Porting: A Self-Improving Agentic Harness for Scientific Program Optimization
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The upgrade and rewriting of large scientific codebases has traditionally been a major challenge. While evolutionary search with large language models (LLMs) can port and accelerate legacy code, repair feedback in prompts alone does not prevent subsequent candidates from repeating the same errors. We introduce Certificate-Driven Evolutionary Search (CDES), which extends evolutionary search with enforceable restrictions derived from failed candidates, recorded as certificates of assumptions, checker evidence, and justified restrictions. Its control logic enforces these restrictions through rejection, backtracking, and targeted repair while preserving compatible edits. We apply CDES to CPU-to-GPU translation of two particle-simulation functions from the Geant4 toolkit, evaluated with a harness that goes beyond unit tests to combine formal checks, numerical comparisons, physics checks, and GPU safety tests. Generated implementations achieve 13.78x and 23.54x function-level speedups over CPU code, including data conversion and transfers; for one function, GPU throughput exceeds an expert implementation by 14.9%, reaching 16.1% when complementary components are combined. In an ablation over execution settings, certificate feedback increases the fraction of candidates passing required correctness checks from 55% to 90%.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 33 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
15 of 33 references.
References · 15
- 2024LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworkscited by 178
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2019The Lean mathematical librarycited by 127
- 2025An AI system to help scientists write expert-level empirical softwarecited by 52
- 2017Program Synthesis using Conflict-Driven Learningcited by 26
- 2015Program Synthesis from Polymorphic Refinement Typescited by 20
- 2024RLSF: Fine-tuning LLMs via Symbolic Feedbackcited by 13
- 2017Program Synthesis using Abstraction Refinementcited by 12
- 2017Horn-ICE Learning for Synthesizing Invariants and Contractscited by 11
- 2024HepLean: Digitalising high energy physicscited by 10
- 2025Equivalence Checking of ML GPU Kernelscited by 7
- 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Modelscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Don't Regenerate, Debug: A Domain-Specific Agent for Repairing Near-Miss Hardware Operators
- 2026Large Language Model-Powered Evolutionary Code Optimization on a Phylogenetic Tree
- 2026FuzzAgent: Multi-Agent System for Evolutionary Library Fuzzing
- 2026Component-Aware Feedback for Self-Evolving Programs
- 2026Simple Baselines are Competitive with Code Evolution
- 2025RustEvo^2: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation
- 2025From Legacy Fortran to Portable Kokkos: An Autonomous Agentic AI Workflow
- 2026RepoRescue: An Empirical Study of LLM Agents on Whole-Repository Compatibility Rescue