mlsanityData to 7 Oct 2026

API Pack: A Massive Multi-Programming Language Dataset for API Call Generation

arXiv 2402.09615 ↗First posted 14 Feb 2024cs.CL cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We introduce API Pack, a massive multi-programming language dataset containing over one million instruction-API calls for improving the API call generation capabilities of large language models. Our evaluation highlights three key findings: First, fine-tuning on API Pack enables open-source models to outperform GPT-3.5 and GPT-4 in generating code for entirely new API calls. We show this by fine-tuning CodeLlama-13B on 20,000 Python instances from API Pack. Second, fine-tuning on a large dataset in one language, combined with smaller datasets from others, improves API generation accuracy across multiple languages. Third, we confirm the benefits of larger datasets for API generalization, as increasing fine-tuning data to one million instances enhances generalization to new APIs. To support further research, we open-source the API Pack dataset, trained model, and code at https://github.com/zguo0525/API-Pack.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 34 of its 79 references that are in the map. First posted on arXiv 14 Feb 2024.

Builds on

34 of 79 references.

References · 34

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  7. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  8. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  9. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  10. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  11. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  12. 2023StarCoder: may the source be with you!cited by 790
22 more
  1. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  2. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  3. 2022A Systematic Evaluation of Large Language Models of Codecited by 360
  4. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
  5. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  6. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  7. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 197
  8. 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 178
  9. 2023Large Language Models for Software Engineering: Survey and Open Problemscited by 178
  10. 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 163
  11. 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
  12. 2024EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instructioncited by 153
  13. 2022Large Language Models Meet NL2Code: A Surveycited by 135
  14. 2022Automatic Generation of Programming Exercises and Code Explanations using Large Language Modelscited by 124
  15. 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
  16. 2023#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Modelscited by 108
  17. 2022Repository-Level Prompt Generation for Large Language Models of Codecited by 106
  18. 2023The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Developmentcited by 95
  19. 2023A Multi-Task Embedder For Retrieval Augmented LLMscited by 63
  20. 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 53
  21. 2023ToolCoder: Teach Code Generation Models to use API search toolscited by 37
  22. 2023Let's Chat to Find the APIs: Connecting Human, LLM and Knowledge Graph through AI Chaincited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

  1. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 61
  2. 2025Kanana: Compute-efficient Bilingual Language Modelscited by 19
  3. 2025Delegated Authorization for Agents Constrained to Semantic Task-to-Scope Matchingcited by 5
  4. 2026Intent2Tx: Benchmarking LLMs for Translating Natural Language Intents into Ethereum Transactionscited by 1
  5. 2026MMBench-Live: A Continuously Evolving Benchmark for Multimodal Modelscited by 0