Large Language Model Guided Self-Debugging Code Generation
Not on the map. Why?
Abstract (arXiv)
Automated code generation is gaining significant importance in intelligent computer programming and system deployment. However, current approaches often face challenges in computational efficiency and lack robust mechanisms for code parsing and error correction. In this work, we propose a novel framework, PyCapsule, with a simple yet effective two-agent pipeline and efficient self-debugging modules for Python code generation. PyCapsule features sophisticated prompt inference, iterative error handling, and case testing, ensuring high generation stability, safety, and correctness. Empirically, PyCapsule achieves up to 5.7% improvement of success rate on HumanEval, 10.3% on HumanEval-ET, and 24.4% on BigCodeBench compared to the state-of-art methods. We also observe a decrease in normalized success rate given more self-debugging attempts, potentially affected by limited and noisy error feedback in retention. PyCapsule demonstrates broader impacts on advancing lightweight and efficient code generation for artificial intelligence systems.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
18 of 36 references.
References · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 286
- 2023Large Language Models for Software Engineering: Survey and Open Problemscited by 181
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 127
6 more
- 2022Repair Is Nearly Generation: Multilingual Program Repair with LLMscited by 68
- 2023CodeScore: Evaluating Code Generation by Learning Code Executioncited by 67
- 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 53
- 2023CodeCoT: Tackling Code Syntax Errors in CoT Reasoning for Code Generationcited by 29
- 2024An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Projectcited by 28
- 2024Large Language Models as Test Case Generators: Performance Evaluation and Enhancementcited by 28
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 15
- 2025SRLCG: Self-Rectified Large-Scale Code Generation with Multidimensional Chain-of-Thought and Dynamic Backtrackingcited by 2
- 2026Adaptive Hierarchical Evaluation of LLMs and SAST tools for CWE Prediction in Pythoncited by 1
- 2026UPA: Unsupervised Prompt Agent via Tree-Based Search and Selectioncited by 1
- 2026MAS-Algorithm: A Workflow for Solving Algorithmic Programming Problems with a Multi-Agent Systemcited by 0
- 2026Microskill Architecture: A Modular Skill-Driven Framework for AI-Native Code Generationcited by 0
- 2026From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Pythoncited by 0
- 2026MineValiCoder: Reliable Code Generation with Test Case Quality Mining and Bipartite Graph-Based Mutual Validationcited by 0
- 2026MineValiCoder: Reliable Code Generation with Test Case Quality Mining and Bipartite Graph-Based Mutual Validation24 Jul 2026
- 2026From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python23 Jul 2026
- 2026Microskill Architecture: A Modular Skill-Driven Framework for AI-Native Code Generation4 Jun 2026
- 2026MAS-Algorithm: A Workflow for Solving Algorithmic Programming Problems with a Multi-Agent System7 May 2026
- 2026UPA: Unsupervised Prompt Agent via Tree-Based Search and Selection30 Jan 2026
- 2026Adaptive Hierarchical Evaluation of LLMs and SAST tools for CWE Prediction in Python4 Jan 2026
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence23 Nov 2025
- 2025SRLCG: Self-Rectified Large-Scale Code Generation with Multidimensional Chain-of-Thought and Dynamic Backtracking1 Apr 2025