mlsanityData to 7 Oct 2026

When Language Model Meets Private Library

arXiv 2210.17236 ↗First posted 31 Oct 2022cs.PL cs.CL cs.SEcited by 54

Not on the map. Why?

Abstract (arXiv)

With the rapid development of pre-training techniques, a number of language models have been pre-trained on large-scale code corpora and perform well in code generation. In this paper, we investigate how to equip pre-trained language models with the ability of code generation for private libraries. In practice, it is common for programmers to write code using private libraries. However, this is a challenge for language models since they have never seen private APIs during training. Motivated by the fact that private libraries usually come with elaborate API documentation, we propose a novel framework with two modules: the APIRetriever finds useful APIs, and then the APICoder generates code using these APIs. For APIRetriever, we present a dense retrieval system and also design a friendly interaction to involve uses. For APICoder, we can directly use off-the-shelf language models, or continually pre-train the base model on a code corpus containing API information. Both modules are trained with data from public libraries and can be generalized to private ones. Furthermore, we craft three benchmarks for private libraries, named TorchDataEval, MonkeyEval, and BeatNumEval. Experimental results demonstrate the impressive performance of our framework.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 33 of its 41 references that are in the map. First posted on arXiv 31 Oct 2022.

Builds on

33 of 41 references.

References · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2021Program Synthesis with Large Language Modelscited by 3,509
  11. 2017Billion-scale similarity search with GPUscited by 2,477
  12. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
21 more
  1. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  2. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  3. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  4. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  5. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  6. 2021Measuring Coding Challenge Competence With APPScited by 879
  7. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  8. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  9. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  10. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
  11. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  12. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  13. 2022CodeT: Code Generation with Generated Testscited by 369
  14. 2021Unified Pre-training for Program Understanding and Generationcited by 361
  15. 2021Retrieval Augmented Code Generation and Summarizationcited by 148
  16. 2022ReACC: A Retrieval-Augmented Code Completion Frameworkcited by 117
  17. 2021Jigsaw: Large Language Models meet Program Synthesiscited by 103
  18. 2022From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effectivecited by 98
  19. 2022CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generationcited by 87
  20. 2016Deep API Learningcited by 41
  21. 2021Programming Puzzlescited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 10; 2024: 26; 2025: 9; 2026: 8.

54 papers.

Sort:

By area:

  1. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  2. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  3. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  4. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 357
  5. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  6. 2022Large Language Models Meet NL2Code: A Surveycited by 135
  7. 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 92
  8. 2023PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedbackcited by 69
  9. 2024A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languagescited by 65
  10. 2024Agents in Software Engineering: Survey, Landscape, and Visioncited by 60
  11. 2024Repoformer: Selective Retrieval for Repository-Level Code Completioncited by 55
  12. 2023BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language Modelscited by 53
38 more
  1. 2024Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generationcited by 49
  2. 2024Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedbackcited by 45
  3. 2023RepoFusion: Training Code Models to Understand Your Repositorycited by 40
  4. 2025MultiKernelBench: A Multi-Platform Benchmark for Kernel Generationcited by 35
  5. 2024SWE-bench-java: A GitHub Issue Resolving Benchmark for Javacited by 34
  6. 2024RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processingcited by 25
  7. 2023BioCoder: A Benchmark for Bioinformatics Code Generation with Large Language Modelscited by 24
  8. 2024EVOR: Evolving Retrieval for Code Generationcited by 22
  9. 2023Guiding Language Models of Code with Global Context using Monitorscited by 20
  10. 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
  11. 2025DocAgent: A Multi-Agent System for Automated Code Documentation Generationcited by 16
  12. 2024Distance between Relevant Information Pieces Causes Bias in Long-Context LLMscited by 15
  13. 2024Towards LifeSpan Cognitive Systemscited by 13
  14. 2024Top General Performance = Top Domain Performance? DomainCodeBench: A Multi-domain Code Generation Benchmarkcited by 13
  15. 2024DocCGen: Document-based Controlled Code Generationcited by 11
  16. 2025A Survey on Transformer Context Extension: Approaches and Evaluationcited by 11
  17. 2024RAMBO: Enhancing RAG-based Repository-Level Method Body Completioncited by 10
  18. 2024Preference-Guided Refactored Tuning for Retrieval Augmented Code Generationcited by 10
  19. 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
  20. 2024The Fault in our Stars: Quality Assessment of Code Generation Benchmarkscited by 9
  21. 2024CATCODER: Repository-Level Code Generation with Relevant Code and Type Contextcited by 8
  22. 2025RESCUE: Retrieval Augmented Secure Code Generationcited by 7
  23. 2025Impact-driven Context Filtering For Cross-file Code Completioncited by 5
  24. 2026RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Modelscited by 5
  25. 2024Exploring Data-Efficient Adaptation of Large Language Models for Code Generationcited by 3
  26. 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Modelcited by 3
  27. 2025Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Unified Approach for Elevating Benchmark Qualitycited by 3
  28. 2026To See is Not to Master: Teaching LLMs to Use Private Libraries for Code Generationcited by 3
  29. 2026Learning from Execution: Self-Evolving Memory for Private-Library Code Generationcited by 2
  30. 2025ASPERA: A Simulated Environment to Evaluate Planning for Complex Action Executioncited by 1
  31. 2025Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Studycited by 1
  32. 2026Unseen-Codebases-Domain Data Synthesis and Training Based on Code Graphscited by 1
  33. 2023Resources and Evaluations for Multi-Distribution Dense Information Retrievalcited by 0
  34. 2023Safurai 001: New Qualitative Approach for Code LLM Evaluationcited by 0
  35. 2023Safurai-Csharp: Harnessing Synthetic Data to improve language-specific Code LLMcited by 0
  36. 2024SwissNYF: Tool Grounded LLM Agents for Black Box Settingcited by 0
  37. 2024Assessing the Answerability of Queries in Retrieval-Augmented Code Generationcited by 0
  38. 2024Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interactioncited by 0

50 most cited of 54 All 54 (JSON)