mlsanityData to 14 Oct 2026

Pythia: AI-assisted Code Completion System

arXiv 1912.00742 ↗First posted 29 Nov 2019cs.SE cs.LGcited by 55

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel end-to-end approach for AI-assisted code completion called Pythia. It generates ranked lists of method and API recommendations which can be used by software developers at edit time. The system is currently deployed as part of Intellicode extension in Visual Studio Code IDE. Pythia exploits state-of-the-art large-scale deep learning models trained on code contexts extracted from abstract syntax trees. It is designed to work at a high throughput predicting the best matching code completions on the order of 100 ms. We describe the architecture of the system, perform comparisons to frequency-based approach and invocation-based Markov Chain language model, and discuss challenges serving Pythia models on lightweight client devices. The offline evaluation results obtained on 2700 Python open source software GitHub repositories show a top-5 accuracy of 92%, surpassing the baseline models by 20% averaged over classes, for both intra and cross-project settings.

Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Nov 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 13; 2023: 15; 2024: 7; 2025: 10; 2026: 1.

55 papers.

Sort:

By area:

  1. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
  2. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
  3. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
  4. 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 60
  5. 2023Privacy in Large Language Models: Attacks, Defenses and Future Directionscited by 51
  6. 2022CodeFill: Multi-token Code Completion by Jointly Learning from Structure and Naming Sequencescited by 50
  7. 2021SpreadsheetCoder: Formula Prediction from Semi-structured Contextcited by 41
  8. 2024Dataflow-Guided Retrieval Augmentation for Repository-Level Code Completioncited by 40
  9. 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detectioncited by 40
  10. 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
  11. 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
  12. 2022Training and Evaluating a Jupyter Notebook Data Science Assistantcited by 31
38 more
  1. 2023Learning Deep Semantics for Test Completioncited by 31
  2. 2021Code Completion by Modeling Flattened Abstract Syntax Trees as Graphscited by 30
  3. 2024Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectivescited by 30
  4. 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 24
  5. 2021Learning to Complete Code with Sketchescited by 23
  6. 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
  7. 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofscited by 18
  8. 2021Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchycited by 14
  9. 2023A Static Evaluation of Code Completion by Large Language Modelscited by 14
  10. 2022Cross-Language Binary-Source Code Matching with Intermediate Representationscited by 13
  11. 2022Don't Complete It! Preventing Unhelpful Code Completion for Productive and Sustainable Neural Code Completion Systemscited by 13
  12. 2025Vibe Coding as a Reconfiguration of Intent Mediation in Software Development: Definition, Implications, and Research Agendacited by 13
  13. 2023Static Code Analysis in the AI Era: An In-depth Exploration of the Concept, Function, and Potential of Intelligent Code Analysis Agentscited by 12
  14. 2025CodeRAG: Finding Relevant and Necessary Knowledge for Retrieval-Augmented Repository-Level Code Completioncited by 12
  15. 2022AutoPruner: Transformer-Based Call Graph Pruningcited by 11
  16. 2024Does Your Neural Code Completion Model Use My Code? A Membership Inference Approachcited by 11
  17. 2022Syntax-Aware On-the-Fly Code Completioncited by 10
  18. 2023kTrans: Knowledge-Aware Transformer for Binary Code Embeddingcited by 10
  19. 2021ManyTypes4Py: A Benchmark Python Dataset for Machine Learning-based Type Inferencecited by 9
  20. 2022All You Need Is Logs: Improving Code Completion by Learning from Anonymous IDE Usage Logscited by 9
  21. 2024Constrained Decoding for Fill-in-the-Middle Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive Grammarscited by 8
  22. 2023Syntax and Domain Aware Model for Unsupervised Program Translationcited by 7
  23. 2024RepoGenReflex: Enhancing Repository-Level Code Completion with Verbal Reinforcement and Retrieval-Augmented Generationcited by 6
  24. 2021Toward Less Hidden Cost of Code Completion with Acceptance and Ranking Modelscited by 5
  25. 2022A Survey of Deep Learning Models for Structural Code Understandingcited by 4
  26. 2025Meta-RAG on Large Codebases Using Code Summarizationcited by 4
  27. 2022A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspectivecited by 3
  28. 2023What are the Machine Learning best practices reported by practitioners on Stack Exchange?cited by 3
  29. 2025Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIMcited by 3
  30. 2025CoTDeceptor:Adversarial Code Obfuscation Against CoT-Enhanced LLM Code Agentscited by 3
  31. 2022Exploring and Evaluating Personalized Models for Code Generationcited by 2
  32. 2022A Survey and Perspective on Artificial Intelligence for Security-Aware Electronic Design Automationcited by 1
  33. 2022Are Machine Programming Systems using Right Source-Code Measures to Select Code Repositories?cited by 1
  34. 2023An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Codecited by 1
  35. 2024The Rise and Fall(?) of Software Engineeringcited by 1
  36. 2025Call Me Maybe: Enhancing JavaScript Call Graph Construction using Graph Neural Networkscited by 1
  37. 2021Embedding Code Contexts for Cryptographic API Suggestion:New Methodologies and Comparisonscited by 0
  38. 2023Serenity: Library Based Python Code Analysis for Code Completion and Automated Machine Learningcited by 0

50 most cited of 55 All 55 (JSON)