Improving Code Summarization with Block-wise Abstract Syntax Tree Splitting
Not on the map. Why?
Abstract (arXiv)
Automatic code summarization frees software developers from the heavy burden of manual commenting and benefits software development and maintenance. Abstract Syntax Tree (AST), which depicts the source code's syntactic structure, has been incorporated to guide the generation of code summaries. However, existing AST based methods suffer from the difficulty of training and generate inadequate code summaries. In this paper, we present the Block-wise Abstract Syntax Tree Splitting method (BASTS for short), which fully utilizes the rich tree-form syntax structure in ASTs, for improving code summarization. BASTS splits the code of a method based on the blocks in the dominator tree of the Control Flow Graph, and generates a split AST for each code split. Each split AST is then modeled by a Tree-LSTM using a pre-training strategy to capture local non-linear syntax encoding. The learned syntax encoding is combined with code encoding, and fed into Transformer to generate high-quality code summaries. Comprehensive experiments on benchmarks have demonstrated that BASTS significantly outperforms state-of-the-art approaches in terms of various evaluation metrics. To facilitate reproducibility, our implementation is available at https://github.com/XMUDM/BASTS.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 14 Mar 2021.
Builds on
27 of 69 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2020Efficient Transformers: A Surveycited by 784
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
- 2018code2vec: Learning Distributed Representations of Codecited by 249
15 more
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 220
- 2017Learning to Represent Programs with Graphscited by 219
- 2018code2seq: Generating Sequences from Structured Representations of Codecited by 177
- 2020A Transformer-based Approach for Source Code Summarizationcited by 129
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
- 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 90
- 2020Improved Code Summarization via a Graph Neural Networkcited by 79
- 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 76
- 2019Code Generation as a Dual Task of Code Summarizationcited by 62
- 2020Deep Learning for Source Code Modeling and Generation: Models, Applications and Challengescited by 55
- 2018Structured Neural Summarizationcited by 53
- 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
- 2020Code to Comment "Translation": Data, Metrics, Baselining & Evaluationcited by 28
- 2019Automatic Code Summarization: A Systematic Literature Reviewcited by 18
- 2014Autofolding for Source Code Summarizationcited by 6
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 4; 2024: 5; 2025: 3.
19 papers.
Sort:
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022Assemble Foundation Models for Automatic Code Summarizationcited by 17
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
- 2022Source Code Summarization with Structural Relative Position Guided Transformercited by 14
- 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarizationcited by 9
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
7 more
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
- 2022A Survey of Deep Learning Models for Structural Code Understandingcited by 4
- 2023Code Search Debiasing:Improve Search Results beyond Overall Ranking Performancecited by 4
- 2025IterMask3D: Unsupervised Anomaly Detection and Segmentation with Test-Time Iterative Mask Refinement in 3D Brain MRcited by 3
- 2024The Rise and Fall(?) of Software Engineeringcited by 1
- 2024On Training a Neural Network to Explain Binariescited by 0
- 2025LLM Based Long Code Translation using Identifier Replacementcited by 0
- 2025LLM Based Long Code Translation using Identifier Replacement10 Oct 2025
- 2025Towards an Understanding of Context Utilization in Code Intelligence11 Apr 2025
- 2025IterMask3D: Unsupervised Anomaly Detection and Segmentation with Test-Time Iterative Mask Refinement in 3D Brain MR7 Apr 2025
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization1 Jul 2024
- 2024The Rise and Fall(?) of Software Engineering14 Jun 2024
- 2024On Training a Neural Network to Explain Binaries30 Apr 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarization21 Feb 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?1 Dec 2023
- 2023Code Search Debiasing:Improve Search Results beyond Overall Ranking Performance25 Nov 2023
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?22 May 2023
7 more
- 2022An Extractive-and-Abstractive Framework for Source Code Summarization15 Jun 2022
- 2022A Survey of Deep Learning Models for Structural Code Understanding3 May 2022
- 2022Source Code Summarization with Structural Relative Position Guided Transformer14 Feb 2022
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey28 Jan 2022
- 2022Assemble Foundation Models for Automatic Code Summarization13 Jan 2022
- 2021A Survey on Machine Learning Techniques for Source Code Analysis18 Oct 2021
- 2021On the Evaluation of Neural Code Summarization15 Jul 2021
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022Assemble Foundation Models for Automatic Code Summarizationcited by 17
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
- 2022Source Code Summarization with Structural Relative Position Guided Transformercited by 14
- 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarizationcited by 9
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
12 most cited of 19 All 19 (JSON)
- 2025LLM Based Long Code Translation using Identifier Replacement10 Oct 2025
- 2025Towards an Understanding of Context Utilization in Code Intelligence11 Apr 2025
- 2025IterMask3D: Unsupervised Anomaly Detection and Segmentation with Test-Time Iterative Mask Refinement in 3D Brain MR7 Apr 2025
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization1 Jul 2024
- 2024The Rise and Fall(?) of Software Engineering14 Jun 2024
- 2024On Training a Neural Network to Explain Binaries30 Apr 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarization21 Feb 2024
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?1 Dec 2023
- 2023Code Search Debiasing:Improve Search Results beyond Overall Ranking Performance25 Nov 2023
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?22 May 2023
12 newest of 19 All 19 (JSON)