mlsanityData to 7 Oct 2026

Exploiting Method Names to Improve Code Summarization: A Deliberation Multi-Task Learning Approach

arXiv 2103.11448 ↗First posted 21 Mar 2021cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Code summaries are brief natural language descriptions of source code pieces. The main purpose of code summarization is to assist developers in understanding code and to reduce documentation workload. In this paper, we design a novel multi-task learning (MTL) approach for code summarization through mining the relationship between method code summaries and method names. More specifically, since a method's name can be considered as a shorter version of its code summary, we first introduce the tasks of generation and informativeness prediction of method names as two auxiliary training objectives for code summarization. A novel two-pass deliberation mechanism is then incorporated into our MTL architecture to generate more consistent intermediate states fed into a summary decoder, especially when informative method names do not exist. To evaluate our deliberation MTL approach, we carried out a large-scale experiment on two existing datasets for Java and Python. The experiment results show that our technique can be easily applied to many state-of-the-art neural models for code summarization and improve their performance. Meanwhile, our approach shows significant superiority when generating summaries for methods with non-informative names.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 21 Mar 2021.

Builds on

22 of 43 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2015Gated Graph Sequence Neural Networkscited by 792
  7. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  8. 2016Cross-stitch Networks for Multi-task Learningcited by 466
  9. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  10. 2018code2vec: Learning Distributed Representations of Codecited by 249
  11. 2018code2seq: Generating Sequences from Structured Representations of Codecited by 177
  12. 2016Dual Learning for Machine Translationcited by 146
10 more
  1. 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
  2. 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 90
  3. 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 76
  4. 2019Code Generation as a Dual Task of Code Summarizationcited by 62
  5. 2017A parallel corpus of Python functions and documentation strings for automated code documentation and code generationcited by 56
  6. 2019Recommendations for Datasets for Source Code Summarizationcited by 46
  7. 2018Automated software vulnerability detection with machine learningcited by 34
  8. 2019CoaCor: Code Annotation for Code Retrieval with Reinforcement Learningcited by 22
  9. 2020Leveraging Code Generation to Improve Code Retrieval and Summarization via Dual Learningcited by 16
  10. 2018Same Representation, Different Attentions: Shareable Sentence Representation Learning from Multiple Taskscited by 9

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 1; 2023: 1.

5 papers.