mlsanityData to 14 Oct 2026

A Survey on Machine Learning Techniques for Source Code Analysis

arXiv 2110.09610 ↗First posted 18 Oct 2021cs.SE cs.LGcited by 24

Not on the map. Why?

Abstract (arXiv)

The advancements in machine learning techniques have encouraged researchers to apply these techniques to a myriad of software engineering tasks that use source code analysis, such as testing and vulnerability detection. Such a large number of studies hinders the community from understanding the current research landscape. This paper aims to summarize the current knowledge in applied machine learning for source code analysis. We review studies belonging to twelve categories of software engineering tasks and corresponding machine learning techniques, tools, and datasets that have been applied to solve them. To do so, we conducted an extensive literature search and identified 479 primary studies published between 2011 and 2021. We summarize our observations and findings with the help of the identified studies. Our findings suggest that the use of machine learning techniques for source code analysis tasks is consistently increasing. We synthesize commonly used steps and the overall workflow for each task and summarize machine learning techniques employed. We identify a comprehensive list of available datasets and tools useable in this context. Finally, the paper discusses perceived challenges in this area, including the availability of standard datasets, reproducibility and replicability, and hardware resources.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 106 of its 517 references that are in the map. First posted on arXiv 18 Oct 2021.

Builds on

106 of 517 references.

References · 106

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Going Deeper with Convolutionscited by 4,241
  3. 2020A Survey of Deep Active Learningcited by 554
  4. 2015LSTM: A Search Space Odysseycited by 316
  5. 2018code2vec: Learning Distributed Representations of Codecited by 250
  6. 2020IntelliCode Compose: Code Generation Using Transformercited by 227
  7. 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
  8. 2017Learning to Represent Programs with Graphscited by 220
  9. 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 218
  10. 2018code2seq: Generating Sequences from Structured Representations of Codecited by 179
  11. 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
  12. 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 145
38 more
  1. 2020A Transformer-based Approach for Source Code Summarizationcited by 133
  2. 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 131
  3. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  4. 2018An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translationcited by 108
  5. 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 100
  6. 2016A Convolutional Attention Network for Extreme Summarization of Source Codecited by 91
  7. 2021CURE: Code-Aware Neural Machine Translation for Automatic Program Repaircited by 86
  8. 2020Improved Code Summarization via a Graph Neural Networkcited by 79
  9. 2019A Neural Model for Generating Natural Language Summaries of Program Subroutinescited by 77
  10. 2018DeepBugs: A Learning Approach to Name-based Bug Detectioncited by 65
  11. 2018Generative Code Modeling with Graphscited by 60
  12. 2018Neural Code Comprehension: A Learnable Representation of Code Semanticscited by 59
  13. 2020Multi-task Learning based Pre-trained Language Model for Code Completioncited by 58
  14. 2017A parallel corpus of Python functions and documentation strings for automated code documentation and code generationcited by 57
  15. 2021A Syntax-Guided Edit Decoder for Neural Program Repaircited by 57
  16. 2019Pythia: AI-assisted Code Completion Systemcited by 55
  17. 2020Deep Learning for Source Code Modeling and Generation: Models, Applications and Challengescited by 55
  18. 2020Big Code != Big Vocabulary: Open-Vocabulary Models for Source Codecited by 54
  19. 2019On Learning Meaningful Code Changes via Neural Machine Translationcited by 50
  20. 2017Code Completion with Neural Attention and Pointer Networkscited by 49
  21. 2019Recommendations for Datasets for Source Code Summarizationcited by 46
  22. 2021Applying CodeBERT for Automated Program Repair of Java Simple Bugscited by 44
  23. 2017Automatically Generating Commit Messages from Diffs using Neural Machine Translationcited by 42
  24. 2019Getafix: Learning to Fix Bugs Automaticallycited by 41
  25. 2019Multi-Modal Attention Network Learning for Semantic Source Code Retrievalcited by 41
  26. 2018CODIT: Code Editing with Tree-Based Neural Modelscited by 40
  27. 2019Neural Program Repair by Jointly Learning to Localize and Repaircited by 40
  28. 2020CC2Vec: Distributed Representations of Code Changescited by 39
  29. 2020Fast and Memory-Efficient Neural Code Completioncited by 38
  30. 2020Improved Automatic Summarization of Subroutines via Attention to File Contextcited by 34
  31. 2020A Software Engineering Perspective on Engineering Machine Learning Systems: State of the Art and Challengescited by 33
  32. 2017Survey of Machine Learning Techniques for Malware Analysiscited by 31
  33. 2018StaQC: A Systematically Mined Question-Code Dataset from Stack Overflowcited by 30
  34. 2019DeepFault: Fault Localization for Deep Neural Networkscited by 30
  35. 2018A General Path-Based Representation for Predicting Program Propertiescited by 29
  36. 2019A Manually-Curated Dataset of Fixes to Vulnerabilities of Open-Source Softwarecited by 28
  37. 2019Automatic Source Code Summarization with Extended Tree-LSTMcited by 28
  38. 2017Sorting and Transforming Program Repair Ingredients via Deep Learning Code Similaritiescited by 26

50 most cited of 106 All 106 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 9; 2023: 7; 2024: 4; 2025: 0; 2026: 2.

24 papers.

Sort:

By area:

  1. 2022Large Language Models Meet NL2Code: A Surveycited by 138
  2. 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
  3. 2022Learning to Parallelize in a Shared-Memory Environment with Transformerscited by 10
  4. 2024Review of Generative AI Methods in Cybersecuritycited by 9
  5. 2022Syntax-Guided Program Reduction for Understanding Neural Code Intelligence Modelscited by 7
  6. 2022CodeS: Towards Code Model Generalization Under Distribution Shiftcited by 6
  7. 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classificationcited by 5
  8. 2023MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformerscited by 5
  9. 2021Code2Snapshot: Using Code Snapshots for Learning Representations of Source Codecited by 4
  10. 2022NeuDep: Neural Binary Memory Dependence Analysiscited by 3
  11. 2021End to End Software Engineering Researchcited by 2
  12. 2023DACOS-A Manually Annotated Dataset of Code Smellscited by 2
12 more
  1. 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contractscited by 2
  2. 2022Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methodscited by 1
  3. 2022Evaluating the Impact of Source Code Parsers on ML4SE Modelscited by 1
  4. 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Codecited by 1
  5. 2023Can You Improve My Code? Optimizing Programs with Local Searchcited by 1
  6. 2024Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Featurescited by 1
  7. 2024On the Effectiveness of Machine Learning-based Call Graph Pruning: An Empirical Studycited by 1
  8. 2026An Empirical Study of the Imbalance Issue in Software Vulnerability Detectioncited by 1
  9. 2022Extracting Label-specific Key Input Features for Neural Code Intelligence Modelscited by 0
  10. 2022CV4Code: Sourcecode Understanding via Visual Code Representationscited by 0
  11. 2024CONCORD: Towards a DSL for Configurable Graph Code Representationcited by 0
  12. 2026Analyzing Chain of Thought (CoT) Approaches in Control Flow Code Deobfuscation Taskscited by 0