mlsanityData to 7 Oct 2026

Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Survey

arXiv 2412.20367 ↗First posted 29 Dec 2024cs.SE cs.CLcited by 82

Not on the map. Why?

Abstract (arXiv)

With the rapid evolution of large language models (LLM), reinforcement learning (RL) has emerged as a pivotal technique for code generation and optimization in various domains. This paper presents a systematic survey of the application of RL in code optimization and generation, highlighting its role in enhancing compiler optimization, resource allocation, and the development of frameworks and tools. Subsequent sections first delve into the intricate processes of compiler optimization, where RL algorithms are leveraged to improve efficiency and resource utilization. The discussion then progresses to the function of RL in resource allocation, emphasizing register allocation and system optimization. We also explore the burgeoning role of frameworks and tools in code generation, examining how RL can be integrated to bolster their capabilities. This survey aims to serve as a comprehensive resource for researchers and practitioners interested in harnessing the power of RL to advance code generation and optimization techniques.

Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 29 Dec 2024.

Builds on

40 of 66 references.

References · 40

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  8. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
  9. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  10. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  11. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  12. 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,227
28 more
  1. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  2. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  3. 2023StarCoder: may the source be with you!cited by 790
  4. 2024A Survey on Large Language Models for Code Generationcited by 646
  5. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  6. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
  7. 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 220
  8. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  9. 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
  10. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
  11. 2024CodeGemma: Open Code Models Based on Gemmacited by 145
  12. 2023On decoder-only architecture for speech-to-text and large language model integrationcited by 144
  13. 2024Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methodscited by 114
  14. 2022ReCode: Robustness Evaluation of Code Generation Modelscited by 100
  15. 2024StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedbackcited by 74
  16. 2024EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositoriescited by 71
  17. 2024We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMscited by 61
  18. 2024FullStack Bench: Evaluating LLMs as Full Stack Coderscited by 56
  19. 2023Large Language Models for Compiler Optimizationcited by 52
  20. 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 52
  21. 2020The Deep Learning Compiler: A Comprehensive Surveycited by 46
  22. 2024LeDex: Training LLMs to Better Self-Debug and Explain Codecited by 39
  23. 2024MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generationcited by 25
  24. 2019Understanding Geometry of Encoder-Decoder CNNscited by 13
  25. 2024Applying RLAIF for Code Generation with API-usage in Lightweight LLMscited by 10
  26. 2023Instruction Fusion: Advancing Prompt Evolution through Hybridizationcited by 7
  27. 2022A Survey on Natural Language Processing for Programmingcited by 3
  28. 2024A Reinforcement Learning Environment for Automatic Code Optimization in the MLIR Compilercited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 62; 2026: 20.

82 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  2. 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
  3. 2025Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLcited by 38
  4. 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 38
  5. 2025Navigate the Unknown: Enhancing LLM Reasoning with Intrinsic Motivation Guided Explorationcited by 33
  6. 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
  7. 2026Look Inward to Explore Outward: Learning Temperature Policy from LLM Internal States via Hierarchical RLcited by 27
  8. 2025GraphRAG under Firecited by 23
  9. 2025Evaluating Supervised Learning Models for Fraud Detection: A Comparative Study of Classical and Deep Architectures on Imbalanced Transaction Datacited by 20
  10. 2025Reasoning Beyond Limits: Advances and Open Problems for LLMscited by 16
  11. 2026Benchmarking Reward Hack Detection in Code Environments via Contrastive Analysiscited by 15
  12. 2025Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimizationcited by 14
38 more
  1. 2025ForgetMe: Evaluating Selective Forgetting in Generative Modelscited by 11
  2. 2025VeriCoder: Enhancing LLM-Based RTL Code Generation through Functional Correctness Validationcited by 11
  3. 2025DSPC: Dual-Stage Progressive Compression Framework for Efficient Long-Context Reasoningcited by 9
  4. 2026Advancing General-Purpose Reasoning Models with Modular Gradient Surgerycited by 9
  5. 2025User Behavior Analysis in Privacy Protection with Large Language Models: A Study on Privacy Preferences with Limited Datacited by 8
  6. 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 7
  7. 2025LLM-Driven E-Commerce Marketing Content Optimization: Balancing Creativity and Conversioncited by 7
  8. 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networkscited by 6
  9. 2025Research on Model Parallelism and Data Parallelism Optimization Methods in Large Language Model-Based Recommendation Systemscited by 6
  10. 2026MDAgent2: Large Language Model for Code Generation and Knowledge Q&A in Molecular Dynamicscited by 6
  11. 2025AI-Driven Prognostics for State of Health Prediction in Li-ion Batteries: A Comprehensive Analysis with Validationcited by 5
  12. 2025RAST: Reasoning Activation in LLMs via Small-model Transfercited by 5
  13. 2025Meta-Learning for Cold-Start Personalization in Prompt-Tuned LLMscited by 5
  14. 2025RLHF Fine-Tuning of LLMs for Alignment with Implicit User Feedback in Conversational Recommenderscited by 5
  15. 2026Controllable and Verifiable Tool-Use Data Synthesis for Agentic Reinforcement Learningcited by 5
  16. 2025A Narrative Review on Large AI Models in Lung Cancer Screening, Diagnosis, and Treatment Planningcited by 4
  17. 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
  18. 2025Code Reasoning for Software Engineering Tasks: A Survey and A Call to Actioncited by 4
  19. 2025DRAFT-RL: Multi-Agent Chain-of-Draft Reasoning for Reinforcement Learning-Enhanced LLMscited by 4
  20. 2025Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systemscited by 3
  21. 2025Rewarding the Journey, Not Just the Destination: A Composite Path and Answer Self-Scoring Reward Mechanism for Test-Time Reinforcement Learningcited by 3
  22. 2025PerfCoder: Large Language Models for Interpretable Code Performance Optimizationcited by 3
  23. 2026Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMscited by 3
  24. 2025MARS: Memory-Enhanced Agents with Reflective Self-improvementcited by 2
  25. 2025Credit Risk Analysis for SMEs Using Graph Neural Networks in Supply Chaincited by 2
  26. 2025LLM-Augmented Symptom Analysis for Cardiovascular Disease Risk Prediction: A Clinical NLPcited by 2
  27. 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Modelscited by 2
  28. 2025Efficient Cold-Start Recommendation via BPE Token-Level Embedding Initialization with LLMcited by 2
  29. 2025VeriLLM: A Lightweight Framework for Publicly Verifiable Decentralized Inferencecited by 2
  30. 2026ChatShopBuddy: Towards Reliable Conversational Shopping Agents via Reinforcement Learningcited by 2
  31. 2026AdaFuse: Accelerating Dynamic Adapter Inference via Token-Level Pre-Gating and Fused Kernel Optimizationcited by 2
  32. 2026Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learningcited by 2
  33. 2025TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generationcited by 1
  34. 2025Large Language Models for Zero-Shot Multicultural Name Recognitioncited by 1
  35. 2025Low-Cost Test-Time Adaptation for Robust Video Editingcited by 1
  36. 2025CAP-LLM: Context-Augmented Personalized Large Language Models for News Headline Generationcited by 1
  37. 2025Coarse-to-Fine Personalized LLM Impressions for Streamlined Radiology Reportscited by 1
  38. 2025A Machine Learning-Based Study on the Synergistic Optimization of Supply Chain Management and Financial Supply Chains from an Economic Perspectivecited by 1

50 most cited of 82 All 82 (JSON)