TritonRL: Training LLMs to Think and Code Triton Without Cheating
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
The rapid evolution of Large Language Models (LLMs) has driven a growing demand for automated, high-performance system kernels to accelerate machine learning workloads. We introduce TritonRL, a domain-specialized 8B-scale LLM for Triton programming, trained via a novel reinforcement learning (RL) framework. While Triton synthesis faces unique challenges, including data scarcity and a high susceptibility to reward hacking, our approach enables robust kernel generation through two primary innovations. First, we implement a multi-layered verification system that provides high-fidelity reward signals, ensuring that generated kernels are both syntactically and functionally valid. Second, we propose Hierarchical Reward Decomposition (HRD), which decouples reinforcement for high-level reasoning and low-level implementation to resolve the credit assignment problem in long-sequence generation. Comprehensive evaluations on KernelBench demonstrate that TritonRL achieves state-of-the-art correctness and runtime speedup, outperforming concurrent Triton-specific models and matching the performance of frontier models with over 100B parameters. Our results highlight the effectiveness of hardware-aware RL paradigms in specialized domain adaptation.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 29 references that are in the map. First posted on arXiv 18 Oct 2025.
Builds on
16 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2025AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning22 May
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
- 2024On Designing Effective RL Reward at Training Time for LLM Reasoning19 Oct
Other references · 12
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 225
- 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 78
- 2025TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operatorscited by 75
- 2025CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learningcited by 61
- 2025Seed-Coder: Let the Code Model Curate Data for Itselfcited by 49
- 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 40
- 2024Aioli: A Unified Optimization Framework for Language Model Data Mixingcited by 34
- 2025RLAD: Training LLMs to Discover Abstractions for Solving Reasoning Problemscited by 21
Built on by
Citing papers per year: 2025: 3; 2026: 21.
24 papers.
Sort:
By area:
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimizationcited by 23
- 2026Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generationscited by 22
- 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimizationcited by 13
- 2026KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernelscited by 12
- 2026Towards Automated Kernel Generation in the Era of LLMscited by 11
- 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimizationcited by 11
- 2026AscendCraft: Automatic Ascend NPU Kernel Generation via DSL-Guided Transcompilationcited by 7
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 5
- 2026DICE: Diffusion Large Language Models Excel at Generating CUDA Kernelscited by 3
- 2026Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesiscited by 3
- 2026DRTriton: Large-Scale Synthetic Data Driven Reinforcement Learning for Triton Kernel Generationcited by 3
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimizationcited by 3
12 more
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimizationcited by 3
- 2025KernelBand: Steering LLM-based Kernel Optimization via Hardware-Aware Multi-Armed Banditscited by 2
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworkscited by 2
- 2026From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generationcited by 1
- 2026Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generationcited by 1
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generationcited by 1
- 2026DataKernelBench: Can LLMs Optimize Database Queries on GPUs?cited by 1
- 2026Step-TP: A Grounded, Step-Level Dataset with Chain-of-Thought Reasoning for LLM-Guided Tensor Program Optimizationcited by 0
- 2026EGG: An Expert-Guided Agent Framework for Kernel Generationcited by 0
- 2026KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?cited by 0
- 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimizationcited by 0
- 2026PTXBench: Benchmarking and Adapting LLMs for GPU Kernel Optimization with Architecture-specific PTXcited by 0
- 2026DataKernelBench: Can LLMs Optimize Database Queries on GPUs?25 Aug 2026
- 2026PTXBench: Benchmarking and Adapting LLMs for GPU Kernel Optimization with Architecture-specific PTX18 Aug 2026
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks12 Aug 2026
- 2026KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?22 Jul 2026
- 2026Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generation2 Jul 2026
- 2026EGG: An Expert-Guided Agent Framework for Kernel Generation25 Jun 2026
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generation20 Jun 2026
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization15 Jun 2026
- 2026From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generation15 Jun 2026
- 2026Step-TP: A Grounded, Step-Level Dataset with Chain-of-Thought Reasoning for LLM-Guided Tensor Program Optimization25 May 2026
- 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimization19 May 2026
- 2026KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels6 May 2026
12 more
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimization24 Mar 2026
- 2026DRTriton: Large-Scale Synthetic Data Driven Reinforcement Learning for Triton Kernel Generation23 Mar 2026
- 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimization12 Mar 2026
- 2026Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesis11 Mar 2026
- 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization10 Mar 2026
- 2026DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels12 Feb 2026
- 2026Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations5 Feb 2026
- 2026AscendCraft: Automatic Ascend NPU Kernel Generation via DSL-Guided Transcompilation30 Jan 2026
- 2026Towards Automated Kernel Generation in the Era of LLMs22 Jan 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025KernelBand: Steering LLM-based Kernel Optimization via Hardware-Aware Multi-Armed Bandits24 Nov 2025
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization19 Nov 2025
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimizationcited by 23
- 2026Towards Automated Kernel Generation in the Era of LLMscited by 11
- 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimizationcited by 11
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 5
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generationcited by 1
- 2026EGG: An Expert-Guided Agent Framework for Kernel Generationcited by 0
- 2026KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?cited by 0
- 2026KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?22 Jul 2026
- 2026EGG: An Expert-Guided Agent Framework for Kernel Generation25 Jun 2026
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generation20 Jun 2026
- 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization10 Mar 2026
- 2026Towards Automated Kernel Generation in the Era of LLMs22 Jan 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization19 Nov 2025
- 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimizationcited by 13
- 2026KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernelscited by 12
- 2026AscendCraft: Automatic Ascend NPU Kernel Generation via DSL-Guided Transcompilationcited by 7
- 2026DICE: Diffusion Large Language Models Excel at Generating CUDA Kernelscited by 3
- 2026Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesiscited by 3
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimizationcited by 3
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimizationcited by 3
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworkscited by 2
- 2026From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generationcited by 1
- 2026Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generationcited by 1
- 2026DataKernelBench: Can LLMs Optimize Database Queries on GPUs?cited by 1
- 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimizationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026DataKernelBench: Can LLMs Optimize Database Queries on GPUs?25 Aug 2026
- 2026PTXBench: Benchmarking and Adapting LLMs for GPU Kernel Optimization with Architecture-specific PTX18 Aug 2026
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks12 Aug 2026
- 2026Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generation2 Jul 2026
- 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization15 Jun 2026
- 2026From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generation15 Jun 2026
- 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimization19 May 2026
- 2026KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels6 May 2026
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimization24 Mar 2026
- 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimization12 Mar 2026
- 2026Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesis11 Mar 2026
- 2026DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels12 Feb 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
- 2025TTRL: Test-Time Reinforcement Learning
- 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning
- 2026DecompRL: Solving Harder Problems by Learning Modular Code Generation
- 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models
- 2025Incentivizing LLMs to Self-Verify Their Answers
- 2025Token-Efficient RL for LLM Reasoning
- 2025JustRL: Scaling a 1.5B LLM with a Simple RL Recipe