KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimization
Not on the map. Why?
Abstract (arXiv)
Automating GPU kernel optimization remains difficult in practice: generated variants can violate correctness constraints, runtime measurements are noisy, and search often stalls early. We present a practical optimization agent that combines LLM-guided mutation, adaptive resource allocation, policy-gated evaluation, and profiler-informed diagnosis. The system screens many candidates with low-cost evaluation and allocates higher-fidelity budget only to promising survivors to optimize and evolve GPU kernels. On important Triton kernel generation tasks, this design improves both kernel quality and search efficiency, reaching 0.88x-6.72x speedup over PyTorch and up to 1.4x speedup over the state-of-the-art kernel agent, with up to 48% lower optimization time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
17 of 34 references.
References · 17
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2025FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Servingcited by 258
- 2018A System for Massively Parallel Hyperparameter Tuningcited by 202
- 2026CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generationcited by 47
- 2025CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimizationcited by 45
- 2025CUDA-LLM: LLMs Can Write Efficient CUDA Kernelscited by 34
- 2025STARK: Strategic Team of Agents for Refining Kernelscited by 25
- 2025TritonRL: Training LLMs to Think and Code Triton Without Cheatingcited by 24
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Searchcited by 24
- 2025TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimizationcited by 16
- 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimizationcited by 13
5 more
- 2026KernelBlaster: Continual Cross-Task CUDA Optimization via Memory-Augmented In-Context Reinforcement Learningcited by 12
- 2025cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolutioncited by 7
- 2026StitchCUDA: An Automated Multi-Agents End-to-End GPU Programing Framework with Rubric-based Agentic Reinforcement Learningcited by 7
- 2026CuTeGen: An LLM-Based Agentic Framework for Generation and Optimization of High-Performance GPU Kernels using CuTecited by 6
- 2025PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformationscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Kernel Foundry: A Diagnosis-driven Evolutionary Kernel Optimizer with Multi-Experts
- 2026KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization
- 2026SpecGen: Accelerating Agentic Kernel Optimization with Speculative Generation ↗
- 2026KernelArc: A Multi-Agent Framework for GPU Kernel Optimization
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance
- 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization
- 2026Agentic Kernel Optimization: Generating State-of-the-Art GPU Kernels Without Hand-Written CUDA
- 2026Kernel-Smith: A Unified Recipe for Evolutionary Kernel Optimization