mlsanityData to 14 Oct 2026

Project-Level Encoding for Neural Source Code Summarization of Subroutines

arXiv 2103.11599 ↗First posted 22 Mar 2021cs.SE cs.LGcited by 24

Not on the map. Why?

Abstract (arXiv)

Source code summarization of a subroutine is the task of writing a short, natural language description of that subroutine. The description usually serves in documentation aimed at programmers, where even brief phrase (e.g. "compresses data to a zip file") can help readers rapidly comprehend what a subroutine does without resorting to reading the code itself. Techniques based on neural networks (and encoder-decoder model designs in particular) have established themselves as the state-of-the-art. Yet a problem widely recognized with these models is that they assume the information needed to create a summary is present within the code being summarized itself - an assumption which is at odds with program comprehension literature. Thus a current research frontier lies in the question of encoding source code context into neural models of summarization. In this paper, we present a project-level encoder to improve models of code summarization. By project-level, we mean that we create a vectorized representation of selected code files in a software project, and use that representation to augment the encoder of state-of-the-art neural code summarization techniques. We demonstrate how our encoder improves several existing models, and provide guidelines for maximizing improvement while controlling time and resource costs in model size.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 22 Mar 2021.

Builds on

23 of 60 references.

References · 23

  1. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  2. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  3. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  4. 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 263
  5. 2018code2vec: Learning Distributed Representations of Codecited by 250
  6. 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
  7. 2017Learning to Represent Programs with Graphscited by 220
  8. 2018code2seq: Generating Sequences from Structured Representations of Codecited by 179
  9. 2020A Transformer-based Approach for Source Code Summarizationcited by 133
  10. 2018The Adverse Effects of Code Duplication in Machine Learning Models of Codecited by 126
  11. 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 100
  12. 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
11 more
  1. 2020Improved Code Summarization via a Graph Neural Networkcited by 79
  2. 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 77
  3. 2021Language-Agnostic Representation Learning of Source Code from Structure and Contextcited by 63
  4. 2019Recommendations for Datasets for Source Code Summarizationcited by 46
  5. 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
  6. 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
  7. 2017A Neural Architecture for Generating Natural Language Descriptions from Source Code Changescited by 23
  8. 2020A Multi-Perspective Architecture for Semantic Code Searchcited by 20
  9. 2018Automatic Generation of Text Descriptive Comments for Code Blockscited by 18
  10. 2021Action Word Prediction for Neural Source Code Summarizationcited by 11
  11. 2018Context-aware Cascade Attention-based RNN for Video Emotion Recognitioncited by 1

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 4; 2023: 10; 2024: 3; 2025: 4.

24 papers.

Sort:

  1. 2021On the Evaluation of Neural Code Summarizationcited by 48
  2. 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
  3. 2023Distilled GPT for Source Code Summarizationcited by 31
  4. 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 24
  5. 2022CoCoSoDa: Effective Contrastive Learning for Code Searchcited by 22
  6. 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
  7. 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 18
  8. 2024Model Editing for LLMs4Code: How Far are We?cited by 10
  9. 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
  10. 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarizationcited by 8
  11. 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 8
  12. 2023A Language Model of Java Methods with Train/Test Deduplicationcited by 7
12 more
  1. 2021Code to Comment Translation: A Comparative Study on Model Effectiveness & Errorscited by 6
  2. 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
  3. 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
  4. 2023Revisiting File Context for Source Code Summarizationcited by 3
  5. 2025CoRet: Improved Retriever for Code Editingcited by 3
  6. 2022JEMMA: An Extensible Java Dataset for ML4Code Applicationscited by 2
  7. 2023APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentationcited by 2
  8. 2023Statement-based Memory for Neural Source Code Summarizationcited by 2
  9. 2025Reverse Engineering User Stories from Code using Large Language Modelscited by 2
  10. 2022Meta Learning for Code Summarizationcited by 0
  11. 2024CONCORD: Towards a DSL for Configurable Graph Code Representationcited by 0
  12. 2025AI-Mediated Code Comment Improvementcited by 0