Jointly Learning to Repair Code and Generate Commit Message
Not on the map. Why?
Abstract (arXiv)
We propose a novel task of jointly repairing program codes and generating commit messages. Code repair and commit message generation are two essential and related tasks for software development. However, existing work usually performs the two tasks independently. We construct a multilingual triple dataset including buggy code, fixed code, and commit messages for this novel task. We provide the cascaded models as baseline, which are enhanced with different training approaches, including the teacher-student method, the multi-task method, and the back-translation method. To deal with the error propagation problem of the cascaded method, the joint model is proposed that can both repair the code and generate the commit message in a unified framework. Experimental results show that the enhanced cascaded model with teacher-student method and multitask-learning method achieves the best score on different metrics of automated code repair, and the joint model behaves better than the cascaded model on commit message generation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 25 Sep 2021.
Builds on
28 of 56 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
16 more
- 2020Unsupervised Translation of Programming Languagescited by 262
- 2020IntelliCode Compose: Code Generation Using Transformercited by 225
- 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 144
- 2018Tree-to-tree Neural Networks for Program Translationcited by 93
- 2020Graph-based, Self-Supervised Program Repair from Diagnostic Feedbackcited by 93
- 2020PyMT5: multi-mode translation of natural language and Python code with transformerscited by 80
- 2016Edinburgh Neural Machine Translation Systems for WMT 16cited by 76
- 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
- 2019Neural Program Repair by Jointly Learning to Localize and Repaircited by 39
- 2019ATOM: Commit Message Generation Based on Abstract Syntax Tree and Hybrid Rankingcited by 25
- 2017A Neural Architecture for Generating Natural Language Descriptions from Source Code Changescited by 23
- 2017A Teacher-Student Framework for Zero-Resource Neural Machine Translationcited by 22
- 2018Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Studycited by 22
- 2020CoreGen: Contextualized Code Representation Learning for Commit Message Generationcited by 15
- 2018Learning How to Mutate Source Code from Bug-Fixescited by 13
- 2020TAG : Type Auxiliary Guiding for Code Comment Generationcited by 8
Built on by
Citing papers per year: 2023: 2.
2 papers.