mlsanityData to 7 Oct 2026

Improving Code Summarization with Block-wise Abstract Syntax Tree Splitting

arXiv 2103.07845 ↗First posted 14 Mar 2021cs.SE cs.AI cs.CLcited by 19

Not on the map. Why?

Abstract (arXiv)

Automatic code summarization frees software developers from the heavy burden of manual commenting and benefits software development and maintenance. Abstract Syntax Tree (AST), which depicts the source code's syntactic structure, has been incorporated to guide the generation of code summaries. However, existing AST based methods suffer from the difficulty of training and generate inadequate code summaries. In this paper, we present the Block-wise Abstract Syntax Tree Splitting method (BASTS for short), which fully utilizes the rich tree-form syntax structure in ASTs, for improving code summarization. BASTS splits the code of a method based on the blocks in the dominator tree of the Control Flow Graph, and generates a split AST for each code split. Each split AST is then modeled by a Tree-LSTM using a pre-training strategy to capture local non-linear syntax encoding. The learned syntax encoding is combined with code encoding, and fed into Transformer to generate high-quality code summaries. Comprehensive experiments on benchmarks have demonstrated that BASTS significantly outperforms state-of-the-art approaches in terms of various evaluation metrics. To facilitate reproducibility, our implementation is available at https://github.com/XMUDM/BASTS.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 14 Mar 2021.

Builds on

27 of 69 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  6. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  7. 2015Gated Graph Sequence Neural Networkscited by 792
  8. 2020Efficient Transformers: A Surveycited by 784
  9. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  10. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  11. 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
  12. 2018code2vec: Learning Distributed Representations of Codecited by 249
15 more
  1. 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 220
  2. 2017Learning to Represent Programs with Graphscited by 219
  3. 2018code2seq: Generating Sequences from Structured Representations of Codecited by 177
  4. 2020A Transformer-based Approach for Source Code Summarizationcited by 129
  5. 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
  6. 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 90
  7. 2020Improved Code Summarization via a Graph Neural Networkcited by 79
  8. 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 76
  9. 2019Code Generation as a Dual Task of Code Summarizationcited by 62
  10. 2020Deep Learning for Source Code Modeling and Generation: Models, Applications and Challengescited by 55
  11. 2018Structured Neural Summarizationcited by 53
  12. 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
  13. 2020Code to Comment "Translation": Data, Metrics, Baselining & Evaluationcited by 28
  14. 2019Automatic Code Summarization: A Systematic Literature Reviewcited by 18
  15. 2014Autofolding for Source Code Summarizationcited by 6

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 5; 2023: 4; 2024: 5; 2025: 3.

19 papers.

Sort:

  1. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  2. 2021On the Evaluation of Neural Code Summarizationcited by 47
  3. 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
  4. 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
  5. 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
  6. 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
  7. 2022Assemble Foundation Models for Automatic Code Summarizationcited by 17
  8. 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
  9. 2022Source Code Summarization with Structural Relative Position Guided Transformercited by 14
  10. 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
  11. 2024EyeTrans: Merging Human and Machine Attention for Neural Code Summarizationcited by 9
  12. 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
7 more
  1. 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
  2. 2022A Survey of Deep Learning Models for Structural Code Understandingcited by 4
  3. 2023Code Search Debiasing:Improve Search Results beyond Overall Ranking Performancecited by 4
  4. 2025IterMask3D: Unsupervised Anomaly Detection and Segmentation with Test-Time Iterative Mask Refinement in 3D Brain MRcited by 3
  5. 2024The Rise and Fall(?) of Software Engineeringcited by 1
  6. 2024On Training a Neural Network to Explain Binariescited by 0
  7. 2025LLM Based Long Code Translation using Identifier Replacementcited by 0