A Survey on Machine Learning Techniques for Source Code Analysis
Not on the map. Why?
Abstract (arXiv)
The advancements in machine learning techniques have encouraged researchers to apply these techniques to a myriad of software engineering tasks that use source code analysis, such as testing and vulnerability detection. Such a large number of studies hinders the community from understanding the current research landscape. This paper aims to summarize the current knowledge in applied machine learning for source code analysis. We review studies belonging to twelve categories of software engineering tasks and corresponding machine learning techniques, tools, and datasets that have been applied to solve them. To do so, we conducted an extensive literature search and identified 479 primary studies published between 2011 and 2021. We summarize our observations and findings with the help of the identified studies. Our findings suggest that the use of machine learning techniques for source code analysis tasks is consistently increasing. We synthesize commonly used steps and the overall workflow for each task and summarize machine learning techniques employed. We identify a comprehensive list of available datasets and tools useable in this context. Finally, the paper discusses perceived challenges in this area, including the availability of standard datasets, reproducibility and replicability, and hardware resources.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 106 of its 517 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
106 of 517 references.
References · 106
- 2017Attention Is All You Needcited by 60,361
- 2014Going Deeper with Convolutionscited by 4,241
- 2020A Survey of Deep Active Learningcited by 554
- 2015LSTM: A Search Space Odysseycited by 316
- 2018code2vec: Learning Distributed Representations of Codecited by 250
- 2020IntelliCode Compose: Code Generation Using Transformercited by 227
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
- 2017Learning to Represent Programs with Graphscited by 220
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 218
- 2018code2seq: Generating Sequences from Structured Representations of Codecited by 179
- 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
- 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 145
38 more
- 2020A Transformer-based Approach for Source Code Summarizationcited by 133
- 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 131
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2018An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translationcited by 108
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 100
- 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 91
- 2021CURE: Code-Aware Neural Machine Translation for Automatic Program Repaircited by 86
- 2020Improved Code Summarization via a Graph Neural Networkcited by 79
- 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 77
- 2018DeepBugs: A Learning Approach to Name-based Bug Detectioncited by 65
- 2018Generative Code Modeling with Graphscited by 60
- 2018Neural Code Comprehension: A Learnable Representation of Code Semanticscited by 59
- 2020Multi-task Learning based Pre-trained Language Model for Code Completioncited by 58
- 2017A parallel corpus of Python functions and documentation strings for automated code documentation and code generationcited by 57
- 2021A Syntax-Guided Edit Decoder for Neural Program Repaircited by 57
- 2019Pythia: AI-assisted Code Completion Systemcited by 55
- 2020Deep Learning for Source Code Modeling and Generation: Models, Applications and Challengescited by 55
- 2020Big Code != Big Vocabulary: Open-Vocabulary Models for Source Codecited by 54
- 2019On Learning Meaningful Code Changes via Neural Machine Translationcited by 50
- 2017Code Completion with Neural Attention and Pointer Networkscited by 49
- 2019Recommendations for Datasets for Source Code Summarizationcited by 46
- 2021Applying CodeBERT for Automated Program Repair of Java Simple Bugscited by 44
- 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
- 2019Getafix: Learning to Fix Bugs Automaticallycited by 41
- 2019Multi-Modal Attention Network Learning for Semantic Source Code Retrievalcited by 41
- 2018CODIT: Code Editing with Tree-Based Neural Modelscited by 40
- 2019Neural Program Repair by Jointly Learning to Localize and Repaircited by 40
- 2020CC2Vec: Distributed Representations of Code Changescited by 39
- 2020Fast and Memory-Efficient Neural Code Completioncited by 38
- 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
- 2020A Software Engineering Perspective on Engineering Machine Learning Systems: State of the Art and Challengescited by 33
- 2017Survey of Machine Learning Techniques for Malware Analysiscited by 31
- 2018StaQC: A Systematically Mined Question-Code Dataset from Stack Overflowcited by 30
- 2019DeepFault: Fault Localization for Deep Neural Networkscited by 30
- 2018A General Path-Based Representation for Predicting Program Propertiescited by 29
- 2019A Manually-Curated Dataset of Fixes to Vulnerabilities of Open-Source Softwarecited by 28
- 2019Automatic Source Code Summarization with Extended Tree-LSTMcited by 28
- 2017Sorting and Transforming Program Repair Ingredients via Deep Learning Code Similaritiescited by 26
50 most cited of 106 All 106 (JSON)
Built on by
Citing papers per year: 2021: 2; 2022: 9; 2023: 7; 2024: 4; 2025: 0; 2026: 2.
24 papers.
Sort:
By area:
- 2022Large Language Models Meet NL2Code: A Surveycited by 138
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
- 2022Learning to Parallelize in a Shared-Memory Environment with Transformerscited by 10
- 2024Review of Generative AI Methods in Cybersecuritycited by 9
- 2022Syntax-Guided Program Reduction for Understanding Neural Code Intelligence Modelscited by 7
- 2022CodeS: Towards Code Model Generalization Under Distribution Shiftcited by 6
- 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classificationcited by 5
- 2023MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformerscited by 5
- 2021Code2Snapshot: Using Code Snapshots for Learning Representations of Source Codecited by 4
- 2022NeuDep: Neural Binary Memory Dependence Analysiscited by 3
- 2021End to End Software Engineering Researchcited by 2
- 2023DACOS-A Manually Annotated Dataset of Code Smellscited by 2
12 more
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contractscited by 2
- 2022Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methodscited by 1
- 2022Evaluating the Impact of Source Code Parsers on ML4SE Modelscited by 1
- 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Codecited by 1
- 2023Can You Improve My Code? Optimizing Programs with Local Searchcited by 1
- 2024Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Featurescited by 1
- 2024On the Effectiveness of Machine Learning-based Call Graph Pruning: An Empirical Studycited by 1
- 2026An Empirical Study of the Imbalance Issue in Software Vulnerability Detectioncited by 1
- 2022Extracting Label-specific Key Input Features for Neural Code Intelligence Modelscited by 0
- 2022CV4Code: Sourcecode Understanding via Visual Code Representationscited by 0
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representationcited by 0
- 2026Analyzing Chain of Thought (CoT) Approaches in Control Flow Code Deobfuscation Taskscited by 0
- 2026Analyzing Chain of Thought (CoT) Approaches in Control Flow Code Deobfuscation Tasks16 Apr 2026
- 2026An Empirical Study of the Imbalance Issue in Software Vulnerability Detection12 Feb 2026
- 2024Review of Generative AI Methods in Cybersecurity13 Mar 2024
- 2024On the Effectiveness of Machine Learning-based Call Graph Pruning: An Empirical Study11 Feb 2024
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representation31 Jan 2024
- 2024Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Features10 Jan 2024
- 2023Can You Improve My Code? Optimizing Programs with Local Search10 Jul 2023
- 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code5 Jul 2023
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review4 Jul 2023
- 2023MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers16 May 2023
- 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification8 May 2023
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts21 Apr 2023
12 more
- 2023DACOS-A Manually Annotated Dataset of Code Smells15 Mar 2023
- 2022Large Language Models Meet NL2Code: A Survey19 Dec 2022
- 2022NeuDep: Neural Binary Memory Dependence Analysis4 Oct 2022
- 2022Evaluating the Impact of Source Code Parsers on ML4SE Models17 Jun 2022
- 2022CodeS: Towards Code Model Generalization Under Distribution Shift11 Jun 2022
- 2022Syntax-Guided Program Reduction for Understanding Neural Code Intelligence Models28 May 2022
- 2022CV4Code: Sourcecode Understanding via Visual Code Representations11 May 2022
- 2022Learning to Parallelize in a Shared-Memory Environment with Transformers27 Apr 2022
- 2022Extracting Label-specific Key Input Features for Neural Code Intelligence Models14 Feb 2022
- 2022Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methods7 Feb 2022
- 2021End to End Software Engineering Research22 Dec 2021
- 2021Code2Snapshot: Using Code Snapshots for Learning Representations of Source Code1 Nov 2021
- 2024Review of Generative AI Methods in Cybersecuritycited by 9
- 2024Review of Generative AI Methods in Cybersecurity13 Mar 2024
- 2022Large Language Models Meet NL2Code: A Surveycited by 138
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
- 2022Learning to Parallelize in a Shared-Memory Environment with Transformerscited by 10
- 2022Syntax-Guided Program Reduction for Understanding Neural Code Intelligence Modelscited by 7
- 2022CodeS: Towards Code Model Generalization Under Distribution Shiftcited by 6
- 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classificationcited by 5
- 2023MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformerscited by 5
- 2021Code2Snapshot: Using Code Snapshots for Learning Representations of Source Codecited by 4
- 2022NeuDep: Neural Binary Memory Dependence Analysiscited by 3
- 2021End to End Software Engineering Researchcited by 2
- 2023DACOS-A Manually Annotated Dataset of Code Smellscited by 2
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contractscited by 2
12 most cited of 22 All 22 (JSON)
- 2026An Empirical Study of the Imbalance Issue in Software Vulnerability Detection12 Feb 2026
- 2024On the Effectiveness of Machine Learning-based Call Graph Pruning: An Empirical Study11 Feb 2024
- 2024CONCORD: Towards a DSL for Configurable Graph Code Representation31 Jan 2024
- 2024Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Features10 Jan 2024
- 2023Can You Improve My Code? Optimizing Programs with Local Search10 Jul 2023
- 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code5 Jul 2023
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review4 Jul 2023
- 2023MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers16 May 2023
- 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification8 May 2023
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts21 Apr 2023
- 2023DACOS-A Manually Annotated Dataset of Code Smells15 Mar 2023
- 2022Large Language Models Meet NL2Code: A Survey19 Dec 2022
12 newest of 22 All 22 (JSON)