mlsanityData to 7 Oct 2026

Kernel Foundry: A Diagnosis-driven Evolutionary Kernel Optimizer with Multi-Experts

arXiv 2605.30359 ↗First posted 8 May 2026cs.NE cs.DC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating high-performance GPU kernels remains challenging due to the need for both correctness and hardware-aware optimization. While large language models (LLMs) show promise in code generation, they often fail to produce kernels that are both correct and efficient. We propose Kernel Foundry, a diagnosis-driven evolutionary framework for automatic GPU kernel optimization. Our method combines expert-guided, retrieval-augmented initialization with a multi-island evolutionary search, where candidate kernels are iteratively refined using structured diagnostic feedback. A centralized experience library accumulates reusable optimization knowledge to guide subsequent evolution, while explicit mechanisms prevent cheating behaviors that bypass kernel-level computation. Experiments on KernelBench show that our method consistently improves both correctness and performance over strong baselines, achieving up to 100% correctness on Level~2.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 27 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

11 of 27 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  5. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  6. 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 206
  7. 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 73
  8. 2025CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learningcited by 59
  9. 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 38
  10. 2025SwizzlePerf: Hardware-Aware LLMs for GPU Kernel Performance Optimizationcited by 11
  11. 2024Graphcode: Learning from multiparameter persistent homology using graph neural networkscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimization
  2. 2025GPU Kernel Scientist: An LLM-Driven Framework for Iterative Kernel Optimization
  3. 2026Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization
  4. 2026KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
  5. 2026FastKernels: Benchmarking GPU Kernel Generation in Production
  6. 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization
  7. 2026K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
  8. 2025PRAGMA: A Profiling-Reasoned Multi-Agent Framework for Automatic Kernel Optimization