Exploiting Method Names to Improve Code Summarization: A Deliberation Multi-Task Learning Approach
Not on the map. Why?
Abstract (arXiv)
Code summaries are brief natural language descriptions of source code pieces. The main purpose of code summarization is to assist developers in understanding code and to reduce documentation workload. In this paper, we design a novel multi-task learning (MTL) approach for code summarization through mining the relationship between method code summaries and method names. More specifically, since a method's name can be considered as a shorter version of its code summary, we first introduce the tasks of generation and informativeness prediction of method names as two auxiliary training objectives for code summarization. A novel two-pass deliberation mechanism is then incorporated into our MTL architecture to generate more consistent intermediate states fed into a summary decoder, especially when informative method names do not exist. To evaluate our deliberation MTL approach, we carried out a large-scale experiment on two existing datasets for Java and Python. The experiment results show that our technique can be easily applied to many state-of-the-art neural models for code summarization and improve their performance. Meanwhile, our approach shows significant superiority when generating summaries for methods with non-informative names.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 21 Mar 2021.
Builds on
22 of 43 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2018code2vec: Learning Distributed Representations of Codecited by 249
- 2018code2seq: Generating Sequences from Structured Representations of Codecited by 177
- 2016Dual Learning for Machine Translationcited by 146
10 more
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
- 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 90
- 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 76
- 2019Code Generation as a Dual Task of Code Summarizationcited by 62
- 2017A parallel corpus of Python functions and documentation strings for automated code documentation and code generationcited by 56
- 2019Recommendations for Datasets for Source Code Summarizationcited by 46
- 2018Automated software vulnerability detection with machine learningcited by 34
- 2019CoaCor: Code Annotation for Code Retrieval with Reinforcement Learningcited by 22
- 2020Leveraging Code Generation to Improve Code Retrieval and Summarization via Dual Learningcited by 16
- 2018Same Representation, Different Attentions: Shareable Sentence Representation Learning from Multiple Taskscited by 9
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 1.
5 papers.
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2021Code Structure Guided Transformer for Source Code Summarizationcited by 29
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2022M2TS: Multi-Scale Multi-Modal Approach Based on Transformer for Source Code Summarizationcited by 14
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit30 Dec 2023
- 2022M2TS: Multi-Scale Multi-Modal Approach Based on Transformer for Source Code Summarization18 Mar 2022
- 2021A Survey on Machine Learning Techniques for Source Code Analysis18 Oct 2021
- 2021On the Evaluation of Neural Code Summarization15 Jul 2021
- 2021Code Structure Guided Transformer for Source Code Summarization19 Apr 2021