A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective
Not on the map. Why?
Abstract (arXiv)
In this survey paper, we overview major deep learning methods used in Natural Language Processing (NLP) and source code over the last 35 years. Next, we present a survey of the applications of Artificial Intelligence (AI) for source code, also known as Code Intelligence (CI) and Programming Language Processing (PLP). We survey over 287 publications and present a software-engineering centered taxonomy for CI placing each of the works into one category describing how it best assists the software development cycle. Then, we overview the field of conversational assistants and their applications in software engineering and education. Lastly, we highlight research opportunities at the intersection of AI for code and conversational assistants and provide future directions for researching conversational assistants with CI capabilities.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 130 of its 263 references that are in the map. First posted on arXiv 10 Feb 2022.
Builds on
130 of 263 references.
References · 130
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016Layer Normalizationcited by 5,579
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
38 more
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2015Pointer Networkscited by 882
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
- 2020Unsupervised Translation of Programming Languagescited by 262
- 2020IntelliCode Compose: Code Generation Using Transformercited by 225
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 220
- 2016Incorporating Copying Mechanism in Sequence-to-Sequence Learningcited by 217
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 199
50 most cited of 130 All 130 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 1.
3 papers.