mlsanityData to 7 Oct 2026

ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Design

arXiv 2303.07839 ↗First posted 11 Mar 2023cs.SE cs.AIcited by 66

Not on the map. Why?

Abstract (arXiv)

This paper presents prompt design techniques for software engineering, in the form of patterns, to solve common problems when using large language models (LLMs), such as ChatGPT to automate common software engineering activities, such as ensuring code is decoupled from third-party libraries and simulating a web application API before it is implemented. This paper provides two contributions to research on using LLMs for software engineering. First, it provides a catalog of patterns for software engineering that classifies patterns according to the types of problems they solve. Second, it explores several prompt patterns that have been applied to improve requirements elicitation, rapid prototyping, code quality, refactoring, and system design.

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 11 Mar 2023.

Builds on

13 of 30 references.

References · 13

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  4. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  5. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  6. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
  7. 2023Mathematical Capabilities of ChatGPTcited by 263
  8. 2023A Categorical Archive of ChatGPT Failurescited by 167
  9. 2023An Analysis of the Automatic Bug Fixing Performance of ChatGPTcited by 108
  10. 2022Is GitHub's Copilot as Bad as Humans at Introducing Vulnerabilities in Code?cited by 63
  11. 2023Conversational Automated Program Repaircited by 41
  12. 2023ChatGPT and Software Testing Education: Promises & Perilscited by 40
1 more
  1. 2017Applying Software Patterns to Address Interoperability in Blockchain-based Healthcare Appscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 22; 2024: 22; 2025: 18; 2026: 4.

66 papers.

Sort:

By area:

  1. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  2. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
  3. 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
  4. 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
  5. 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 39
  6. 2024Best Practices for Text Annotation with Large Language Modelscited by 34
  7. 2024SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agentscited by 34
  8. 2024MARE: Multi-Agents Collaboration Framework for Requirements Engineeringcited by 28
  9. 2023Refactoring Programs Using Large Language Models with Few-Shot Examplescited by 27
  10. 2023ChatGPT for Programming Numerical Methodscited by 26
  11. 2024PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedbackcited by 22
  12. 2023Enhancing Network Management Using Code Generated by Large Language Modelscited by 20
38 more
  1. 2024Performance-Aligned LLMs for Generating Fast Codecited by 20
  2. 2023Decoding ChatGPT: A Taxonomy of Existing Research, Current Challenges, and Possible Future Directionscited by 18
  3. 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectivescited by 16
  4. 2023From Commit Message Generation to History-Aware Commit Message Completioncited by 16
  5. 2023LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPTcited by 15
  6. 2024SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimizationcited by 14
  7. 2024LLM-based agents for automating the enhancement of user story quality: An early reportcited by 13
  8. 2023Comparing Software Developers with ChatGPT: An Empirical Investigationcited by 11
  9. 2023An Empirical Study on Using Large Language Models to Analyze Software Supply Chain Security Failurescited by 11
  10. 2024Model Generation with LLMs: From Requirements to UML Sequence Diagramscited by 11
  11. 2025MANTRA: Enhancing Automated Method-Level Refactoring with Contextual RAG and Multi-Agent LLM Collaborationcited by 10
  12. 2023ChatGPT for PLC/DCS Control Logic Generationcited by 9
  13. 2023Knowledge Engineering using Large Language Modelscited by 9
  14. 2024Enhancing Computer Programming Education with LLMs: A Study on Effective Prompt Engineering for Python Code Generationcited by 9
  15. 2024Enhancing Robustness in Large Language Models: Prompting for Mitigating the Impact of Irrelevant Informationcited by 8
  16. 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLMcited by 8
  17. 2023On the Opportunities of Green Computing: A Surveycited by 7
  18. 2024Automated User Story Generation with Test Case Specification Using Large Language Modelcited by 7
  19. 2024StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactionscited by 7
  20. 2024LLM4DS: Evaluating Large Language Models for Data Science Code Generationcited by 7
  21. 2023FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repaircited by 6
  22. 2024Leveraging Large Language Models to Detect npm Malicious Packagescited by 6
  23. 2024Had enough of experts? Quantitative knowledge retrieval from large language modelscited by 4
  24. 2024To what extent is ChatGPT useful for language teacher lesson plan creation?cited by 4
  25. 2025The Impact of LLM-Assistants on Software Developer Productivity: A Systematic Review and Mapping Studycited by 4
  26. 2025LLM-Assisted Semantic Alignment and Integration in Collaborative Model-Based Systems Engineering Using SysML v2cited by 4
  27. 2023Toward Reproducing Network Research Results Using Large Language Modelscited by 3
  28. 2024Advancing GenAI Assisted Programming--A Comparative Study on Prompt Efficiency and Code Quality Between GPT-4 and GLM-4cited by 3
  29. 2024SmartLLMSentry: A Comprehensive LLM Based Smart Contract Vulnerability Detection Frameworkcited by 3
  30. 2025LLM-based Multi-Agent System for Intelligent Refactoring of Haskell Codecited by 3
  31. 2023Towards the Exploitation of LLM-based Chatbot for Providing Legal Support to Palestinian Cooperativescited by 2
  32. 2023Evaluating Privacy Questions From Stack Overflow: Can ChatGPT Compete?cited by 2
  33. 2023Large Language Models to the Rescue: Reducing the Complexity in Scientific Workflow Development Using ChatGPTcited by 2
  34. 2024A Qualitative Study on Using ChatGPT for Software Security: Perception vs. Practicalitycited by 2
  35. 2025Boosting Universal LLM Reward Design through Heuristic Reward Observation Space Evolutioncited by 2
  36. 2025Can LLMs Generate User Stories and Assess Their Quality?cited by 2
  37. 2025Leveraging Large Language Models for Use Case Model Generation from Software Requirementscited by 2
  38. 2024The importance of visual modelling languages in generative software engineeringcited by 1

50 most cited of 66 All 66 (JSON)