Improved Code Summarization via a Graph Neural Network
Not on the map. Why?
Abstract (arXiv)
Automatic source code summarization is the task of generating natural language descriptions for source code. Automatic code summarization is a rapidly expanding research area, especially as the community has taken greater advantage of advances in neural network and AI technologies. In general, source code summarization techniques use the source code as input and outputs a natural language description. Yet a strong consensus is developing that using structural information as input leads to improved performance. The first approaches to use structural information flattened the AST into a sequence. Recently, more complex approaches based on random AST paths or graph neural networks have improved on the models using flattened ASTs. However, the literature still does not describe the using a graph neural network together with source code sequence as separate inputs to a model. Therefore, in this paper, we present an approach that uses a graph-based neural architecture that better matches the default structure of the AST to generate these summaries. We evaluate our technique using a data set of 2.1 million Java method-comment pairs and show improvement over four baseline techniques, two from the software engineering literature, and two from machine learning literature.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 22; 2022: 18; 2023: 20; 2024: 7; 2025: 7; 2026: 4.
79 papers.
Sort:
By area:
- 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 72
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2021Multilingual training for Software Engineeringcited by 43
- 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
- 2021TreeBERT: A Tree-Based Pre-Trained Model for Programming Languagecited by 40
- 2023CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generationcited by 39
- 2021Code Completion by Modeling Flattened Abstract Syntax Trees as Graphscited by 30
- 2021CodeQA: A Question Answering Dataset for Source Code Comprehensioncited by 30
- 2021Code Structure Guided Transformer for Source Code Summarizationcited by 29
- 2023The Expressive Power of Graph Neural Networks: A Surveycited by 27
- 2022Probing Pretrained Models of Source Codecited by 26
38 more
- 2021Project-Level Encoding for Neural Source Code Summarization of Subroutinescited by 24
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Codecited by 20
- 2021Improving Code Summarization with Block-wise Abstract Syntax Tree Splittingcited by 19
- 2021Memorization and Generalization in Neural Code Intelligence Modelscited by 17
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
- 2022Source Code Summarization with Structural Relative Position Guided Transformercited by 14
- 2022M2TS: Multi-Scale Multi-Modal Approach Based on Transformer for Source Code Summarizationcited by 14
- 2022Cross-Language Binary-Source Code Matching with Intermediate Representationscited by 13
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
- 2021Impact of Evaluation Methodologies on Code Summarizationcited by 11
- 2023CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Codecited by 11
- 2021API2Com: On the Improvement of Automatically Generated Code Comments Using API Documentationscited by 10
- 2022Learning to Parallelize in a Shared-Memory Environment with Transformerscited by 10
- 2022HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representationscited by 9
- 2022GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimationcited by 9
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarizationcited by 9
- 2021GraphGallery: A Platform for Fast Benchmarking and Easy Development of Graph Neural Networks Based Intelligent Softwarecited by 8
- 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarizationcited by 8
- 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operationscited by 7
- 2024Automated Program Repair: Emerging trends pose and expose problems for benchmarkscited by 7
- 2024Can Developers Prompt? A Controlled Experiment for Code Documentation Generationcited by 7
- 2021HAConvGNN: Hierarchical Attention Based Convolutional Graph Neural Network for Code Documentation Generation in Jupyter Notebookscited by 6
- 2021Code to Comment Translation: A Comparative Study on Model Effectiveness & Errorscited by 6
- 2022Learning Program Semantics with Code Representations: An Empirical Studycited by 6
- 2023Tram: A Token-level Retrieval-augmented Mechanism for Source Code Summarizationcited by 6
- 2021A Neural Question Answering System for Basic Questions about Subroutinescited by 5
- 2021Learning to Generate Code Comments from Class Hierarchiescited by 5
- 2021Improving Stack Overflow question title generation with copying enhanced CodeBERT model and bi-modal informationcited by 5
- 2022GypSum: Learning Hybrid Representations for Code Summarizationcited by 5
- 2022SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Modelscited by 5
- 2023Semantic Similarity Loss for Neural Source Code Summarizationcited by 5
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
- 2022A Survey of Deep Learning Models for Structural Code Understandingcited by 4
- 2023An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Trainingcited by 4
- 2021GN-Transformer: Fusing Sequence and Graph Representation for Improved Code Summarizationcited by 3
- 2023Revisiting File Context for Source Code Summarizationcited by 3
50 most cited of 79 All 79 (JSON)
- 2026Agent4cs: A Multi-agent System for Code Summarization in Large Hierarchical Codebases1 Jul 2026
- 2026PLMGH: What Matters in PLM-GNN Hybrids for Code Classification and Vulnerability Detection28 Apr 2026
- 2026Prompt-Driven Code Summarization: A Systematic Literature Review16 Apr 2026
- 2026ShortCoder: Knowledge-Augmented Syntax Optimization for Token-Efficient Code Generation14 Jan 2026
- 2025BinCtx: Multi-Modal Representation Learning for Robust Android App Behavior Detection16 Oct 2025
- 2025Enhancing Neural Code Representation with Additional Context14 Oct 2025
- 2025Interpreting Performance Profiles with Deep Learning1 Aug 2025
- 2025Simple and Effective Baselines for Code Summarisation Evaluation26 May 2025
- 2025Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Models14 May 2025
- 2025AI-Mediated Code Comment Improvement13 May 2025
- 2025Commenting Higher-level Code Unit: Full Code, Reduced Code, or Hierarchical Code Summarization13 Mar 2025
- 2024Can Developers Prompt? A Controlled Experiment for Code Documentation Generation1 Aug 2024
38 more
- 2024DeepCodeProbe: Towards Understanding What Models Trained on Code Learn11 Jul 2024
- 2024The Rise and Fall(?) of Software Engineering14 Jun 2024
- 2024Automated Program Repair: Emerging trends pose and expose problems for benchmarks8 May 2024
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarization21 Feb 2024
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representation31 Jan 2024
- 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operations11 Jan 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?1 Dec 2023
- 2023Transfer Attacks and Defenses for Large Language Models on Coding Tasks22 Nov 2023
- 2023CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation14 Nov 2023
- 2023CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Code24 Oct 2023
- 2023Leveraging Deep Learning for Abstractive Code Summarization of Unofficial Documentation23 Oct 2023
- 2023Revisiting File Context for Source Code Summarization5 Sep 2023
- 2023An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Training29 Aug 2023
- 2023The Expressive Power of Graph Neural Networks: A Survey16 Aug 2023
- 2023Semantic Similarity Loss for Neural Source Code Summarization14 Aug 2023
- 2023Statement-based Memory for Neural Source Code Summarization21 Jul 2023
- 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code5 Jul 2023
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey23 May 2023
- 2023Tram: A Token-level Retrieval-augmented Mechanism for Source Code Summarization18 May 2023
- 2023Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization16 May 2023
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?24 Apr 2023
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts21 Apr 2023
- 2023Knowledge Transfer for Pseudo-code Generation from Low Resource Programming Language16 Mar 2023
- 2023Judging Adam: Studying the Performance of Optimization Methods on ML4SE Tasks6 Mar 2023
- 2023APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentation3 Mar 2023
- 2022SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models10 Oct 2022
- 2022GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimation8 Oct 2022
- 2022Preprocessing Source Code Comments for Linguistic Models23 Aug 2022
- 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence24 Jul 2022
- 2022An Extractive-and-Abstractive Framework for Source Code Summarization15 Jun 2022
- 2022HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations31 May 2022
- 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code24 May 2022
- 2022A Survey of Deep Learning Models for Structural Code Understanding3 May 2022
- 2022Learning to Parallelize in a Shared-Memory Environment with Transformers27 Apr 2022
- 2022GypSum: Learning Hybrid Representations for Code Summarization26 Apr 2022
- 2022LAMNER: Code Comment Generation Using Character Language Model and Named Entity Recognition5 Apr 2022
- 2022Learning Program Semantics with Code Representations: An Empirical Study22 Mar 2022
50 newest of 79 All 79 (JSON)
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 72
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2021Multilingual training for Software Engineeringcited by 43
- 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
- 2021TreeBERT: A Tree-Based Pre-Trained Model for Programming Languagecited by 40
- 2023CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generationcited by 39
- 2021Code Completion by Modeling Flattened Abstract Syntax Trees as Graphscited by 30
- 2021CodeQA: A Question Answering Dataset for Source Code Comprehensioncited by 30
- 2021Code Structure Guided Transformer for Source Code Summarizationcited by 29
- 2023The Expressive Power of Graph Neural Networks: A Surveycited by 27
- 2022Probing Pretrained Models of Source Codecited by 26
- 2021Project-Level Encoding for Neural Source Code Summarization of Subroutinescited by 24
12 most cited of 75 All 75 (JSON)
- 2026PLMGH: What Matters in PLM-GNN Hybrids for Code Classification and Vulnerability Detection28 Apr 2026
- 2026Prompt-Driven Code Summarization: A Systematic Literature Review16 Apr 2026
- 2025BinCtx: Multi-Modal Representation Learning for Robust Android App Behavior Detection16 Oct 2025
- 2025Enhancing Neural Code Representation with Additional Context14 Oct 2025
- 2025Interpreting Performance Profiles with Deep Learning1 Aug 2025
- 2025Simple and Effective Baselines for Code Summarisation Evaluation26 May 2025
- 2025Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Models14 May 2025
- 2025AI-Mediated Code Comment Improvement13 May 2025
- 2025Commenting Higher-level Code Unit: Full Code, Reduced Code, or Hierarchical Code Summarization13 Mar 2025
- 2024Can Developers Prompt? A Controlled Experiment for Code Documentation Generation1 Aug 2024
- 2024DeepCodeProbe: Towards Understanding What Models Trained on Code Learn11 Jul 2024
- 2024The Rise and Fall(?) of Software Engineering14 Jun 2024
12 newest of 75 All 75 (JSON)