Knowledge Transfer for Pseudo-code Generation from Low Resource Programming Language
Not on the map. Why?
Abstract (arXiv)
Generation of pseudo-code descriptions of legacy source code for software maintenance is a manually intensive task. Recent encoder-decoder language models have shown promise for automating pseudo-code generation for high resource programming languages such as C++, but are heavily reliant on the availability of a large code-pseudocode corpus. Soliciting such pseudocode annotations for codes written in legacy programming languages (PL) is a time consuming and costly affair requiring a thorough understanding of the source PL. In this paper, we focus on transferring the knowledge acquired by the code-to-pseudocode neural model trained on a high resource PL (C++) using parallel code-pseudocode data. We aim to transfer this knowledge to a legacy PL (C) with no PL-pseudocode parallel data for training. To achieve this, we utilize an Iterative Back Translation (IBT) approach with a novel test-cases based filtration strategy, to adapt the trained C++-to-pseudocode model to C-to-pseudocode model. We observe an improvement of 23.27% in the success rate of the generated C codes through back translation, over the successive IBT iteration, illustrating the efficacy of our approach.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 16 Mar 2023.
Builds on
29 of 44 references.
References · 29
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 355
- 2018code2seq: Generating Sequences from Structured Representations of Codecited by 177
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2020A Transformer-based Approach for Source Code Summarizationcited by 129
- 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
17 more
- 2020Graph-based, Self-Supervised Program Repair from Diagnostic Feedbackcited by 93
- 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
- 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
- 2020Improved Code Summarization via a Graph Neural Networkcited by 79
- 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 76
- 2021Language-Agnostic Representation Learning of Source Code from Structure and Contextcited by 63
- 2021CoTexT: Multi-task Learning with Code-Text Transformercited by 61
- 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
- 2021CAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax Treescited by 31
- 2020Code Summarization with Structure-induced Transformercited by 29
- 2021CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 28
- 2020Incremental Sampling Without Replacement for Sequence Modelscited by 23
- 2020Learning to Represent Programs with Heterogeneous Graphscited by 13
- 2020Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalizationcited by 8
- 2021Fine-grained Pseudo-code Generation Method via Code Feature Extraction and Transformercited by 6
- 2020Semantic Scaffolds for Pseudocode-to-Code Generationcited by 5
- 2019Generation of Pseudo Code from the Python Source Code using Rule-Based Machine Translationcited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Scaling Automatic Extraction of Pseudocodecited by 0
- 2024Scaling Automatic Extraction of Pseudocode7 Jun 2024