mlsanityData to 14 Oct 2026

TritonRL: Training LLMs to Think and Code Triton Without Cheating

arXiv 2510.17891 ↗First posted 18 Oct 2025cs.SE cs.LGcited by 24

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

The rapid evolution of Large Language Models (LLMs) has driven a growing demand for automated, high-performance system kernels to accelerate machine learning workloads. We introduce TritonRL, a domain-specialized 8B-scale LLM for Triton programming, trained via a novel reinforcement learning (RL) framework. While Triton synthesis faces unique challenges, including data scarcity and a high susceptibility to reward hacking, our approach enables robust kernel generation through two primary innovations. First, we implement a multi-layered verification system that provides high-fidelity reward signals, ensuring that generated kernels are both syntactically and functionally valid. Second, we propose Hierarchical Reward Decomposition (HRD), which decouples reinforcement for high-level reasoning and low-level implementation to resolve the credit assignment problem in long-sequence generation. Comprehensive evaluations on KernelBench demonstrate that TritonRL achieves state-of-the-art correctness and runtime speedup, outperforming concurrent Triton-specific models and matching the performance of frontier models with over 100B parameters. Our results highlight the effectiveness of hardware-aware RL paradigms in specialized domain adaptation.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 29 references that are in the map. First posted on arXiv 18 Oct 2025.

Builds on

16 of 29 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning22 May
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
  4. 2024On Designing Effective RL Reward at Training Time for LLM Reasoning19 Oct

Other references · 12

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  4. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
  5. 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 225
  6. 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 78
  7. 2025TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operatorscited by 75
  8. 2025CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learningcited by 61
  9. 2025Seed-Coder: Let the Code Model Curate Data for Itselfcited by 49
  10. 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 40
  11. 2024Aioli: A Unified Optimization Framework for Language Model Data Mixingcited by 34
  12. 2025RLAD: Training LLMs to Discover Abstractions for Solving Reasoning Problemscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 21.

24 papers.

Sort:

By area:

  1. 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimizationcited by 23
  2. 2026Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generationscited by 22
  3. 2026KernelFoundry: Hardware-aware evolutionary GPU kernel optimizationcited by 13
  4. 2026KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernelscited by 12
  5. 2026Towards Automated Kernel Generation in the Era of LLMscited by 11
  6. 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimizationcited by 11
  7. 2026AscendCraft: Automatic Ascend NPU Kernel Generation via DSL-Guided Transcompilationcited by 7
  8. 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 5
  9. 2026DICE: Diffusion Large Language Models Excel at Generating CUDA Kernelscited by 3
  10. 2026Towards Cold-Start Drafting and Continual Refining: A Value-Driven Memory Approach with Application to NPU Kernel Synthesiscited by 3
  11. 2026DRTriton: Large-Scale Synthetic Data Driven Reinforcement Learning for Triton Kernel Generationcited by 3
  12. 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimizationcited by 3
12 more
  1. 2026daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimizationcited by 3
  2. 2025KernelBand: Steering LLM-based Kernel Optimization via Hardware-Aware Multi-Armed Banditscited by 2
  3. 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworkscited by 2
  4. 2026From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generationcited by 1
  5. 2026Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generationcited by 1
  6. 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generationcited by 1
  7. 2026DataKernelBench: Can LLMs Optimize Database Queries on GPUs?cited by 1
  8. 2026Step-TP: A Grounded, Step-Level Dataset with Chain-of-Thought Reasoning for LLM-Guided Tensor Program Optimizationcited by 0
  9. 2026EGG: An Expert-Guided Agent Framework for Kernel Generationcited by 0
  10. 2026KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?cited by 0
  11. 2026KernelBrain: Coarse-to-Fine, Budget-Aware Search for Agentic GPU Kernel Optimizationcited by 0
  12. 2026PTXBench: Benchmarking and Adapting LLMs for GPU Kernel Optimization with Architecture-specific PTXcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
  2. 2025TTRL: Test-Time Reinforcement Learning
  3. 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning
  4. 2026DecompRL: Solving Harder Problems by Learning Modular Code Generation
  5. 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models
  6. 2025Incentivizing LLMs to Self-Verify Their Answers
  7. 2025Token-Efficient RL for LLM Reasoning
  8. 2025JustRL: Scaling a 1.5B LLM with a Simple RL Recipe