Kernel Foundry: A Diagnosis-driven Evolutionary Kernel Optimizer with Multi-Experts
Not on the map. Why?
Abstract (arXiv)
Generating high-performance GPU kernels remains challenging due to the need for both correctness and hardware-aware optimization. While large language models (LLMs) show promise in code generation, they often fail to produce kernels that are both correct and efficient. We propose Kernel Foundry, a diagnosis-driven evolutionary framework for automatic GPU kernel optimization. Our method combines expert-guided, retrieval-augmented initialization with a multi-island evolutionary search, where candidate kernels are iteratively refined using structured diagnostic feedback. A centralized experience library accumulates reusable optimization knowledge to guide subsequent evolution, while explicit mechanisms prevent cheating behaviors that bypass kernel-level computation. Experiments on KernelBench show that our method consistently improves both correctness and performance over strong baselines, achieving up to 100% correctness on Level~2.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 27 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
11 of 27 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 206
- 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 73
- 2025CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learningcited by 59
- 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 38
- 2025SwizzlePerf: Hardware-Aware LLMs for GPU Kernel Performance Optimizationcited by 11
- 2024Graphcode: Learning from multiparameter persistent homology using graph neural networkscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimization
- 2025GPU Kernel Scientist: An LLM-Driven Framework for Iterative Kernel Optimization
- 2026Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization
- 2026KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
- 2026FastKernels: Benchmarking GPU Kernel Generation in Production
- 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization
- 2026K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
- 2025PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization