Automatic Code Documentation Generation Using GPT-3
Not on the map. Why?
Abstract (arXiv)
Source code documentation is an important artifact for efficient software development. Code documentation could greatly benefit from automation since manual documentation is often labouring, resource and time-intensive. In this paper, we employed Codex for automatic code documentation creation. Codex is a GPT-3 based model pre-trained on both natural and programming languages. We find that Codex outperforms existing techniques even with basic settings like one-shot learning (i.e., providing only one example for training). Codex achieves an overall BLEU score of 20.6 for six different programming languages (11.2% improvement over earlier state-of-the-art techniques). Thus, Codex shows promise and warrants in-depth future studies for automatic code documentation generation to support diverse development tasks.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Sep 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 10; 2024: 11; 2025: 6; 2026: 10.
37 papers.
Sort:
By area:
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 69
- 2023A Comparative Analysis of Large Language Models for Code Documentation Generationcited by 24
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2024The Landscape and Challenges of HPC Research and LLMscited by 22
- 2024Performance-Aligned LLMs for Generating Fast Codecited by 20
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
- 2023From Commit Message Generation to History-Aware Commit Message Completioncited by 16
- 2023Autonomous Agents in Software Development: A Vision Papercited by 12
- 2023ChatGPT for PLC/DCS Control Logic Generationcited by 9
- 2023Multilingual Code Co-Evolution Using Large Language Modelscited by 9
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
25 more
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generationcited by 7
- 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
- 2023Co-audit: tools to help humans double-check AI-generated contentcited by 5
- 2024ChatGPT Incorrectness Detection in Software Reviewscited by 5
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmapcited by 5
- 2026RepoRepair: Leveraging Code Documentation for Repository-Level Automated Program Repaircited by 5
- 2025Evaluating the Effectiveness of LLMs in Fixing Maintainability Issues in Real-World Projectscited by 4
- 2024CodeCloak: A Method for Evaluating and Mitigating Code Leakage by LLM Code Assistantscited by 3
- 2024Mastering the Craft of Data Synthesis for CodeLLMscited by 3
- 2024MESIA: Understanding and Leveraging Supplementary Nature of Method-level Comments for Automatic Comment Generationcited by 2
- 2025Evaluating the Use of LLMs for Documentation to Code Traceabilitycited by 2
- 2026Evaluating Repository-level Software Documentation via Question Answering and Feature-Driven Developmentcited by 2
- 2024Assessing the Code Clone Detection Capability of Large Language Modelscited by 1
- 2025Impact of Comments on LLM Comprehension of Legacy Codecited by 1
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operationscited by 1
- 2026Q-Bridge: Code Translation for Quantum Machine Learning via LLMscited by 1
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentationcited by 1
- 2023Empowering Business Transformation: The Positive Impact and Ethical Considerations of Generative AI in Software Product Management -- A Systematic Literature Reviewcited by 0
- 2025Issue Retrieval and Verification Enhanced Supplementary Code Comment Generationcited by 0
- 2026Precision in Practice: Knowledge Guided Code Summarizing Grounded in Industrial Expectationscited by 0
- 2026Prompt-Driven Code Summarization: A Systematic Literature Reviewcited by 0
- 2026Benchmarked Yet Not Measured -- Generative AI Should be Evaluated Against Real-World Utilitycited by 0
- 2026The Illusion of Agentic Complexity in README.md Generation: Evaluating Single-Agent vs. Multi-Agent RAG Systemscited by 0
- 2026SAGE-Loop: Reliable Closed-Loop LLM-Driven AutoML with Trial-and-Correction and Adaptive Ensemblingcited by 0
- 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfercited by 0
- 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer25 Sep 2026
- 2026SAGE-Loop: Reliable Closed-Loop LLM-Driven AutoML with Trial-and-Correction and Adaptive Ensembling11 Sep 2026
- 2026The Illusion of Agentic Complexity in README.md Generation: Evaluating Single-Agent vs. Multi-Agent RAG Systems29 Jun 2026
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation14 May 2026
- 2026Benchmarked Yet Not Measured -- Generative AI Should be Evaluated Against Real-World Utility7 May 2026
- 2026Prompt-Driven Code Summarization: A Systematic Literature Review16 Apr 2026
- 2026Evaluating Repository-level Software Documentation via Question Answering and Feature-Driven Development8 Apr 2026
- 2026Q-Bridge: Code Translation for Quantum Machine Learning via LLMs29 Mar 2026
- 2026RepoRepair: Leveraging Code Documentation for Repository-Level Automated Program Repair1 Mar 2026
- 2026Precision in Practice: Knowledge Guided Code Summarizing Grounded in Industrial Expectations3 Feb 2026
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap4 Dec 2025
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operations22 Oct 2025
25 more
- 2025Evaluating the Use of LLMs for Documentation to Code Traceability19 Jun 2025
- 2025Issue Retrieval and Verification Enhanced Supplementary Code Comment Generation17 Jun 2025
- 2025Impact of Comments on LLM Comprehension of Legacy Code23 Apr 2025
- 2025Evaluating the Effectiveness of LLMs in Fixing Maintainability Issues in Real-World Projects4 Feb 2025
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation15 Nov 2024
- 2024Mastering the Craft of Data Synthesis for CodeLLMs16 Oct 2024
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching16 Sep 2024
- 2024Assessing the Code Clone Detection Capability of Large Language Models2 Jul 2024
- 2024Performance-Aligned LLMs for Generating Fast Code29 Apr 2024
- 2024CodeCloak: A Method for Evaluating and Mitigating Code Leakage by LLM Code Assistants13 Apr 2024
- 2024MESIA: Understanding and Leveraging Supplementary Nature of Method-level Comments for Automatic Comment Generation26 Mar 2024
- 2024ChatGPT Incorrectness Detection in Software Reviews25 Mar 2024
- 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generation26 Feb 2024
- 2024The Landscape and Challenges of HPC Research and LLMs3 Feb 2024
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat30 Jan 2024
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape18 Dec 2023
- 2023A Comparative Analysis of Large Language Models for Code Documentation Generation16 Dec 2023
- 2023Autonomous Agents in Software Development: A Vision Paper30 Nov 2023
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-44 Oct 2023
- 2023Co-audit: tools to help humans double-check AI-generated content2 Oct 2023
- 2023From Commit Message Generation to History-Aware Commit Message Completion15 Aug 2023
- 2023Semantic Similarity Loss for Neural Source Code Summarization14 Aug 2023
- 2023Multilingual Code Co-Evolution Using Large Language Models27 Jul 2023
- 2023Empowering Business Transformation: The Positive Impact and Ethical Considerations of Generative AI in Software Product Management -- A Systematic Literature Review5 Jun 2023
- 2023ChatGPT for PLC/DCS Control Logic Generation25 May 2023
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2023Autonomous Agents in Software Development: A Vision Papercited by 12
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentationcited by 1
- 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfercited by 0
- 2026Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not Transfer25 Sep 2026
- 2026Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation14 May 2026
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat30 Jan 2024
- 2023Autonomous Agents in Software Development: A Vision Paper30 Nov 2023
- 2024Mastering the Craft of Data Synthesis for CodeLLMscited by 3
- 2024Mastering the Craft of Data Synthesis for CodeLLMs16 Oct 2024
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 69
- 2023A Comparative Analysis of Large Language Models for Code Documentation Generationcited by 24
- 2024The Landscape and Challenges of HPC Research and LLMscited by 22
- 2024Performance-Aligned LLMs for Generating Fast Codecited by 20
- 2023From Commit Message Generation to History-Aware Commit Message Completioncited by 16
- 2023ChatGPT for PLC/DCS Control Logic Generationcited by 9
- 2023Multilingual Code Co-Evolution Using Large Language Modelscited by 9
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generationcited by 7
- 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
- 2023Co-audit: tools to help humans double-check AI-generated contentcited by 5
12 most cited of 29 All 29 (JSON)
- 2026SAGE-Loop: Reliable Closed-Loop LLM-Driven AutoML with Trial-and-Correction and Adaptive Ensembling11 Sep 2026
- 2026Benchmarked Yet Not Measured -- Generative AI Should be Evaluated Against Real-World Utility7 May 2026
- 2026Prompt-Driven Code Summarization: A Systematic Literature Review16 Apr 2026
- 2026Evaluating Repository-level Software Documentation via Question Answering and Feature-Driven Development8 Apr 2026
- 2026Q-Bridge: Code Translation for Quantum Machine Learning via LLMs29 Mar 2026
- 2026RepoRepair: Leveraging Code Documentation for Repository-Level Automated Program Repair1 Mar 2026
- 2026Precision in Practice: Knowledge Guided Code Summarizing Grounded in Industrial Expectations3 Feb 2026
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap4 Dec 2025
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operations22 Oct 2025
- 2025Evaluating the Use of LLMs for Documentation to Code Traceability19 Jun 2025
- 2025Impact of Comments on LLM Comprehension of Legacy Code23 Apr 2025
- 2025Evaluating the Effectiveness of LLMs in Fixing Maintainability Issues in Real-World Projects4 Feb 2025
12 newest of 29 All 29 (JSON)