mlsanityData to 14 Oct 2026

Prompt engineering and framework: implementation to increase code reliability based guideline for LLMs

arXiv 2506.10989 ↗First posted 19 Mar 2025cs.SE cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and correctness of generated code snippets, enabling them to pass tests and produce reliable results. Through experiments conducted on two state-of-the-art LLMs using the HumanEval dataset, we demonstrate that our approach outperforms widely studied zero-shot and Chain-of-Thought (CoT) methods in terms of the Pass@k metric. Furthermore, our method achieves these improvements with significantly reduced token usage compared to the CoT approach, making it both effective and resource-efficient, thereby lowering the computational demands and improving the eco-footprint of LLM capabilities. These findings highlight the potential of tailored prompting strategies to optimize code generation performance, paving the way for broader applications in AI-driven programming tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 26 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

22 of 26 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  8. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  10. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  11. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  12. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 498
10 more
  1. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  2. 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 117
  3. 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 103
  4. 2023Fairness-guided Few-shot Prompting for Large Language Modelscited by 53
  5. 2024WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Modelscited by 30
  6. 2024PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs)cited by 19
  7. 2023FRANC: A Lightweight Framework for High-Quality Code Generationcited by 14
  8. 2024DocCGen: Document-based Controlled Code Generationcited by 11
  9. 2024Automated Prompt Engineering for Cost-Effective Code Generation Using Evolutionary Algorithmcited by 5
  10. 2024Beyond Code Generation: Assessing Code LLM Maturity with Postconditionscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Low-Cost Language Models: Survey and Performance Evaluation on Python Code Generation
  2. 2024The Impact of Prompt Programming on Function-Level Code Generation
  3. 2026PromptResponse: Optimizing Prompts for LLM Coding Tasks
  4. 2024Understanding Defects in Generated Codes by Language Models
  5. 2026Enhancing Reliability in LLM-Based Secure Code Generation
  6. 2024What Makes Large Language Models Reason in (Multi-Turn) Code Generation?
  7. 2026Aging of Prompt Engineering Techniques Across LLM Versions ↗
  8. 2025Are They All Good? Evaluating the Quality of CoTs in LLM-based Code Generation