mlsanityData to 7 Oct 2026

Improved Code Summarization via a Graph Neural Network

arXiv 2004.02843 ↗First posted 6 Apr 2020cs.SE cs.CLcited by 79

Not on the map. Why?

Abstract (arXiv)

Automatic source code summarization is the task of generating natural language descriptions for source code. Automatic code summarization is a rapidly expanding research area, especially as the community has taken greater advantage of advances in neural network and AI technologies. In general, source code summarization techniques use the source code as input and outputs a natural language description. Yet a strong consensus is developing that using structural information as input leads to improved performance. The first approaches to use structural information flattened the AST into a sequence. Recently, more complex approaches based on random AST paths or graph neural networks have improved on the models using flattened ASTs. However, the literature still does not describe the using a graph neural network together with source code sequence as separate inputs to a model. Therefore, in this paper, we present an approach that uses a graph-based neural architecture that better matches the default structure of the AST to generate these summaries. We evaluate our technique using a data set of 2.1 million Java method-comment pairs and show improvement over four baseline techniques, two from the software engineering literature, and two from machine learning literature.

Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 22; 2022: 18; 2023: 20; 2024: 7; 2025: 7; 2026: 4.

79 papers.

Sort:

By area:

  1. 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
  2. 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 72
  3. 2021On the Evaluation of Neural Code Summarizationcited by 47
  4. 2021Multilingual training for Software Engineeringcited by 43
  5. 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
  6. 2021TreeBERT: A Tree-Based Pre-Trained Model for Programming Languagecited by 40
  7. 2023CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generationcited by 39
  8. 2021Code Completion by Modeling Flattened Abstract Syntax Trees as Graphscited by 30
  9. 2021CodeQA: A Question Answering Dataset for Source Code Comprehensioncited by 30
  10. 2021Code Structure Guided Transformer for Source Code Summarizationcited by 29
  11. 2023The Expressive Power of Graph Neural Networks: A Surveycited by 27
  12. 2022Probing Pretrained Models of Source Codecited by 26
38 more
  1. 2021Project-Level Encoding for Neural Source Code Summarization of Subroutinescited by 24
  2. 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
  3. 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
  4. 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Codecited by 20
  5. 2021Improving Code Summarization with Block-wise Abstract Syntax Tree Splittingcited by 19
  6. 2021Memorization and Generalization in Neural Code Intelligence Modelscited by 17
  7. 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
  8. 2022Source Code Summarization with Structural Relative Position Guided Transformercited by 14
  9. 2022M2TS: Multi-Scale Multi-Modal Approach Based on Transformer for Source Code Summarizationcited by 14
  10. 2022Cross-Language Binary-Source Code Matching with Intermediate Representationscited by 13
  11. 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
  12. 2021Impact of Evaluation Methodologies on Code Summarizationcited by 11
  13. 2023CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Codecited by 11
  14. 2021API2Com: On the Improvement of Automatically Generated Code Comments Using API Documentationscited by 10
  15. 2022Learning to Parallelize in a Shared-Memory Environment with Transformerscited by 10
  16. 2022HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representationscited by 9
  17. 2022GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimationcited by 9
  18. 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarizationcited by 9
  19. 2021GraphGallery: A Platform for Fast Benchmarking and Easy Development of Graph Neural Networks Based Intelligent Softwarecited by 8
  20. 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarizationcited by 8
  21. 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operationscited by 7
  22. 2024Automated Program Repair: Emerging trends pose and expose problems for benchmarkscited by 7
  23. 2024Can Developers Prompt? A Controlled Experiment for Code Documentation Generationcited by 7
  24. 2021HAConvGNN: Hierarchical Attention Based Convolutional Graph Neural Network for Code Documentation Generation in Jupyter Notebookscited by 6
  25. 2021Code to Comment Translation: A Comparative Study on Model Effectiveness & Errorscited by 6
  26. 2022Learning Program Semantics with Code Representations: An Empirical Studycited by 6
  27. 2023Tram: A Token-level Retrieval-augmented Mechanism for Source Code Summarizationcited by 6
  28. 2021A Neural Question Answering System for Basic Questions about Subroutinescited by 5
  29. 2021Learning to Generate Code Comments from Class Hierarchiescited by 5
  30. 2021Improving Stack Overflow question title generation with copying enhanced CodeBERT model and bi-modal informationcited by 5
  31. 2022GypSum: Learning Hybrid Representations for Code Summarizationcited by 5
  32. 2022SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Modelscited by 5
  33. 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
  34. 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
  35. 2022A Survey of Deep Learning Models for Structural Code Understandingcited by 4
  36. 2023An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Trainingcited by 4
  37. 2021GN-Transformer: Fusing Sequence and Graph Representation for Improved Code Summarizationcited by 3
  38. 2023Revisiting File Context for Source Code Summarizationcited by 3

50 most cited of 79 All 79 (JSON)