Project-Level Encoding for Neural Source Code Summarization of Subroutines
Not on the map. Why?
Abstract (arXiv)
Source code summarization of a subroutine is the task of writing a short, natural language description of that subroutine. The description usually serves in documentation aimed at programmers, where even brief phrase (e.g. "compresses data to a zip file") can help readers rapidly comprehend what a subroutine does without resorting to reading the code itself. Techniques based on neural networks (and encoder-decoder model designs in particular) have established themselves as the state-of-the-art. Yet a problem widely recognized with these models is that they assume the information needed to create a summary is present within the code being summarized itself - an assumption which is at odds with program comprehension literature. Thus a current research frontier lies in the question of encoding source code context into neural models of summarization. In this paper, we present a project-level encoder to improve models of code summarization. By project-level, we mean that we create a vectorized representation of selected code files in a software project, and use that representation to augment the encoder of state-of-the-art neural code summarization techniques. We demonstrate how our encoder improves several existing models, and provide guidelines for maximizing improvement while controlling time and resource costs in model size.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 22 Mar 2021.
Builds on
23 of 60 references.
References · 23
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 263
- 2018code2vec: Learning Distributed Representations of Codecited by 250
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
- 2017Learning to Represent Programs with Graphscited by 220
- 2018code2seq: Generating Sequences from Structured Representations of Codecited by 179
- 2020A Transformer-based Approach for Source Code Summarizationcited by 133
- 2018The Adverse Effects of Code Duplication in Machine Learning Models of Codecited by 126
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 100
- 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
11 more
- 2020Improved Code Summarization via a Graph Neural Networkcited by 79
- 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 77
- 2021Language-Agnostic Representation Learning of Source Code from Structure and Contextcited by 63
- 2019Recommendations for Datasets for Source Code Summarizationcited by 46
- 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
- 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
- 2017A Neural Architecture for Generating Natural Language Descriptions from Source Code Changescited by 23
- 2020A Multi-Perspective Architecture for Semantic Code Searchcited by 20
- 2018Automatic Generation of Text Descriptive Comments for Code Blockscited by 18
- 2021Action Word Prediction for Neural Source Code Summarizationcited by 11
- 2018Context-aware Cascade Attention-based RNN for Video Emotion Recognitioncited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 10; 2024: 3; 2025: 4.
24 papers.
Sort:
- 2021On the Evaluation of Neural Code Summarizationcited by 48
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
- 2023Distilled GPT for Source Code Summarizationcited by 31
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 24
- 2022CoCoSoDa: Effective Contrastive Learning for Code Searchcited by 22
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 18
- 2024Model Editing for LLMs4Code: How Far are We?cited by 10
- 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
- 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarizationcited by 8
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 8
- 2023A Language Model of Java Methods with Train/Test Deduplicationcited by 7
12 more
- 2021Code to Comment Translation: A Comparative Study on Model Effectiveness & Errorscited by 6
- 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
- 2023Revisiting File Context for Source Code Summarizationcited by 3
- 2025CoRet: Improved Retriever for Code Editingcited by 3
- 2022JEMMA: An Extensible Java Dataset for ML4Code Applicationscited by 2
- 2023APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentationcited by 2
- 2023Statement-based Memory for Neural Source Code Summarizationcited by 2
- 2025Reverse Engineering User Stories from Code using Large Language Modelscited by 2
- 2022Meta Learning for Code Summarizationcited by 0
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representationcited by 0
- 2025AI-Mediated Code Comment Improvementcited by 0
- 2025Reverse Engineering User Stories from Code using Large Language Models23 Sep 2025
- 2025CoRet: Improved Retriever for Code Editing30 May 2025
- 2025AI-Mediated Code Comment Improvement13 May 2025
- 2025Towards an Understanding of Context Utilization in Code Intelligence11 Apr 2025
- 2024Model Editing for LLMs4Code: How Far are We?11 Nov 2024
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization1 Jul 2024
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representation31 Jan 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?1 Dec 2023
- 2023Revisiting File Context for Source Code Summarization5 Sep 2023
- 2023Distilled GPT for Source Code Summarization28 Aug 2023
- 2023Semantic Similarity Loss for Neural Source Code Summarization14 Aug 2023
12 more
- 2023Statement-based Memory for Neural Source Code Summarization21 Jul 2023
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?22 May 2023
- 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization16 May 2023
- 2023A Language Model of Java Methods with Train/Test Deduplication15 May 2023
- 2023APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentation3 Mar 2023
- 2022JEMMA: An Extensible Java Dataset for ML4Code Applications18 Dec 2022
- 2022An Extractive-and-Abstractive Framework for Source Code Summarization15 Jun 2022
- 2022CoCoSoDa: Effective Contrastive Learning for Code Search7 Apr 2022
- 2022Meta Learning for Code Summarization20 Jan 2022
- 2021A Survey on Machine Learning Techniques for Source Code Analysis18 Oct 2021
- 2021On the Evaluation of Neural Code Summarization15 Jul 2021
- 2021Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors15 Jun 2021
- 2021On the Evaluation of Neural Code Summarizationcited by 48
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
- 2023Distilled GPT for Source Code Summarizationcited by 31
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 24
- 2022CoCoSoDa: Effective Contrastive Learning for Code Searchcited by 22
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 18
- 2024Model Editing for LLMs4Code: How Far are We?cited by 10
- 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
- 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarizationcited by 8
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 8
- 2023A Language Model of Java Methods with Train/Test Deduplicationcited by 7
12 most cited of 24 All 24 (JSON)
- 2025Reverse Engineering User Stories from Code using Large Language Models23 Sep 2025
- 2025CoRet: Improved Retriever for Code Editing30 May 2025
- 2025AI-Mediated Code Comment Improvement13 May 2025
- 2025Towards an Understanding of Context Utilization in Code Intelligence11 Apr 2025
- 2024Model Editing for LLMs4Code: How Far are We?11 Nov 2024
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization1 Jul 2024
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representation31 Jan 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?1 Dec 2023
- 2023Revisiting File Context for Source Code Summarization5 Sep 2023
- 2023Distilled GPT for Source Code Summarization28 Aug 2023
- 2023Semantic Similarity Loss for Neural Source Code Summarization14 Aug 2023
12 newest of 24 All 24 (JSON)