mlsanityData to 7 Oct 2026

Jointly Learning to Repair Code and Generate Commit Message

arXiv 2109.12296 ↗First posted 25 Sep 2021cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We propose a novel task of jointly repairing program codes and generating commit messages. Code repair and commit message generation are two essential and related tasks for software development. However, existing work usually performs the two tasks independently. We construct a multilingual triple dataset including buggy code, fixed code, and commit messages for this novel task. We provide the cascaded models as baseline, which are enhanced with different training approaches, including the teacher-student method, the multi-task method, and the back-translation method. To deal with the error propagation problem of the cascaded method, the joint model is proposed that can both repair the code and generate the commit message in a unified framework. Experimental results show that the enhanced cascaded model with teacher-student method and multitask-learning method achieves the best score on different metrics of automated code repair, and the joint model behaves better than the cascaded model on commit message generation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 25 Sep 2021.

Builds on

28 of 56 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  5. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  7. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  8. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  9. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  10. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  11. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
  12. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
16 more
  1. 2020Unsupervised Translation of Programming Languagescited by 262
  2. 2020IntelliCode Compose: Code Generation Using Transformercited by 225
  3. 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 144
  4. 2018Tree-to-tree Neural Networks for Program Translationcited by 93
  5. 2020Graph-based, Self-Supervised Program Repair from Diagnostic Feedbackcited by 93
  6. 2020PyMT5: multi-mode translation of natural language and Python code with transformerscited by 80
  7. 2016Edinburgh Neural Machine Translation Systems for WMT 16cited by 76
  8. 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
  9. 2019Neural Program Repair by Jointly Learning to Localize and Repaircited by 39
  10. 2019ATOM: Commit Message Generation Based on Abstract Syntax Tree and Hybrid Rankingcited by 25
  11. 2017A Neural Architecture for Generating Natural Language Descriptions from Source Code Changescited by 23
  12. 2017A Teacher-Student Framework for Zero-Resource Neural Machine Translationcited by 22
  13. 2018Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Studycited by 22
  14. 2020CoreGen: Contextualized Code Representation Learning for Commit Message Generationcited by 15
  15. 2018Learning How to Mutate Source Code from Bug-Fixescited by 13
  16. 2020TAG : Type Auxiliary Guiding for Code Comment Generationcited by 8

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.