# Harnessing LLMs for API Interactions: A Framework for Classification and Synthetic Data Generation

arXiv: https://arxiv.org/abs/2409.11703 · HTML: https://mlsanity.com/paper/2409.11703/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs.
- Builds on 28 of its 45 references that are in the map.
- First posted on arXiv 18 Sep 2024.

## Placed in

- Synthetic data and self-improvement for LLMs / [LLM synthetic data generation](https://mlsanity.com/synth/llm-synthetic-data-generation/)

## Builds on (most cited first, 28 of 28)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [GPT-4 Technical Report](https://mlsanity.com/paper/2303.08774/) (2023)
- [Evaluating Large Language Models Trained on Code](https://mlsanity.com/paper/2107.03374/) (2021)
- [BloombergGPT: A Large Language Model for Finance](https://mlsanity.com/paper/2303.17564/) (2023)
- [On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey](https://mlsanity.com/paper/2406.15126/) (2024)
- [TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs](https://mlsanity.com/paper/2303.16434/) (2023)
- [Synchromesh: Reliable code generation from pre-trained language models](https://mlsanity.com/paper/2201.11227/) (2022)
- [RestGPT: Connecting Large Language Models with Real-World RESTful APIs](https://mlsanity.com/paper/2306.06624/) (2023)
- [Can Language Understand Depth?](https://mlsanity.com/paper/2207.01077/) (2022)
- [A Text-guided Protein Design Framework](https://mlsanity.com/paper/2302.04611/) (2023)
- [ComposerX: Multi-Agent Symbolic Music Composition with LLMs](https://mlsanity.com/paper/2404.18081/) (2024)
- [WorDepth: Variational Language Prior for Monocular Depth Estimation](https://mlsanity.com/paper/2404.03635/) (2024)
- [The FacT: Taming Latent Factor Models for Explainability with Factorization Trees](https://mlsanity.com/paper/1906.02037/) (2019)
- [RAG-RLRC-LaySum at BioLaySumm: Integrating Retrieval-Augmented Generation and Readability Control for Layman Summarization of Biomedical Texts](https://mlsanity.com/paper/2405.13179/) (2024)
- [Diffusion Modeling with Domain-conditioned Prior Guidance for Accelerated MRI and qMRI Reconstruction](https://mlsanity.com/paper/2309.00783/) (2023)
- [Prototypical Reward Network for Data-Efficient RLHF](https://mlsanity.com/paper/2406.06606/) (2024)
- [Towards Resilient and Efficient LLMs: A Comparative Study of Efficiency, Performance, and Adversarial Robustness](https://mlsanity.com/paper/2408.04585/) (2024)
- [Identification of Prognostic Biomarkers for Stage III Non-Small Cell Lung Carcinoma in Female Nonsmokers Using Machine Learning](https://mlsanity.com/paper/2408.16068/) (2024)
- [TFWT: Tabular Feature Weighting with Transformer](https://mlsanity.com/paper/2405.08403/) (2024)
- [Prediction of COVID-19 Patients' Emergency Room Revisit using Multi-Source Transfer Learning](https://mlsanity.com/paper/2306.17257/) (2023)
- [Graphical Structural Learning of rs-fMRI data in Heavy Smokers](https://mlsanity.com/paper/2409.08395/) (2024)
- [An Optimal Control Framework for Joint-channel Parallel MRI Reconstruction without Coil Sensitivities](https://mlsanity.com/paper/2109.09738/) (2021)
- [Rhyme-aware Chinese lyric generator based on GPT](https://mlsanity.com/paper/2408.10130/) (2024)
- [Online Learning of Multiple Tasks and Their Relationships : Testing on Spam Email Data and EEG Signals Recorded in Construction Fields](https://mlsanity.com/paper/2406.18311/) (2024)
- [Hedge Fund Portfolio Construction Using PolyModel Theory and iTransformer](https://mlsanity.com/paper/2408.03320/) (2024)
- [LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systems](https://mlsanity.com/paper/2407.12016/) (2024)
- [Exploring the Generalization of Cancer Clinical Trial Eligibility Classifiers Across Diseases](https://mlsanity.com/paper/2403.17135/) (2024)
- [Automated DevOps Pipeline Generation for Code Repositories using Large Language Models](https://mlsanity.com/paper/2312.13225/) (2023)

## Built on by (most cited first, 17 of 17)

- [GTM: Simulating the World of Tools for AI Agents](https://mlsanity.com/paper/2512.04535/) (2025)
- [Adaptive Optimization for Enhanced Efficiency in Large-Scale Language Model Training](https://mlsanity.com/paper/2412.04718/) (2024)
- [CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharing](https://mlsanity.com/paper/2410.16670/) (2024)
- [LoRA-LiteE: A Computationally Efficient Framework for Chatbot Preference-Tuning](https://mlsanity.com/paper/2411.09947/) (2024)
- [Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICs](https://mlsanity.com/paper/2412.14304/) (2024)
- [Enhanced Recommendation Combining Collaborative Filtering and Large Language Models](https://mlsanity.com/paper/2412.18713/) (2024)
- [Leveraging Convolutional Neural Network-Transformer Synergy for Predictive Modeling in Risk-Based Applications](https://mlsanity.com/paper/2412.18222/) (2024)
- [AI-Driven Health Monitoring of Distributed Computing Architecture: Insights from XGBoost and SHAP](https://mlsanity.com/paper/2501.14745/) (2024)
- [Evaluation of LLMs for mathematical problem solving](https://mlsanity.com/paper/2506.00309/) (2025)
- [DeepSeek-Inspired Exploration of RL-based LLMs and Synergy with Wireless Networks: A Survey](https://mlsanity.com/paper/2503.09956/) (2025)
- [Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models](https://mlsanity.com/paper/2412.06249/) (2024)
- [Collaborative Optimization in Financial Data Mining Through Deep Learning and ResNeXt](https://mlsanity.com/paper/2412.17314/) (2024)
- [Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models](https://mlsanity.com/paper/2412.19449/) (2024)
- [Optimizing Large Language Models with an Enhanced LoRA Fine-Tuning Algorithm for Efficiency and Robustness in NLP Tasks](https://mlsanity.com/paper/2412.18729/) (2024)
- [Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer](https://mlsanity.com/paper/2412.18321/) (2024)
- [Dynamic User Interface Generation for Enhanced Human-Computer Interaction Using Variational Autoencoders](https://mlsanity.com/paper/2412.14521/) (2024)
- [LLM Agents for Generating Microservice-based Applications: how complex is your specification?](https://mlsanity.com/paper/2508.20119/) (2025)

## Abstract (arXiv)

As Large Language Models (LLMs) advance in natural language processing, there is growing interest in leveraging their capabilities to simplify software interactions. In this paper, we propose a novel system that integrates LLMs for both classifying natural language inputs into corresponding API calls and automating the creation of sample datasets tailored to specific API functions. By classifying natural language commands, our system allows users to invoke complex software functionalities through simple inputs, improving interaction efficiency and lowering the barrier to software utilization. Our dataset generation approach also enables the efficient and systematic evaluation of different LLMs in classifying API calls, offering a practical tool for developers or business owners to assess the suitability of LLMs for customized API management. We conduct experiments on several prominent LLMs using generated sample datasets for various API functions. The results show that GPT-4 achieves a high classification accuracy of 0.996, while LLaMA-3-8B performs much worse at 0.759. These findings highlight the potential of LLMs to transform API management and validate the effectiveness of our system in guiding model testing and selection across diverse applications.