Automating REST API Postman Test Cases Using LLM
Not on the map. Why?
Abstract (arXiv)
In the contemporary landscape of technological advancements, the automation of manual processes is crucial, compelling the demand for huge datasets to effectively train and test machines. This research paper is dedicated to the exploration and implementation of an automated approach to generate test cases specifically using Large Language Models. The methodology integrates the use of Open AI to enhance the efficiency and effectiveness of test case generation for training and evaluating Large Language Models. This formalized approach with LLMs simplifies the testing process, making it more efficient and comprehensive. Leveraging natural language understanding, LLMs can intelligently formulate test cases that cover a broad range of REST API properties, ensuring comprehensive testing. The model that is developed during the research is trained using manually collected postman test cases or instances for various Rest APIs. LLMs enhance the creation of Postman test cases by automating the generation of varied and intricate test scenarios. Postman test cases offer streamlined automation, collaboration, and dynamic data handling, providing a user-friendly and efficient approach to API testing compared to traditional test cases. Thus, the model developed not only conforms to current technological standards but also holds the promise of evolving into an idea of substantial importance in future technological advancements.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 4 of its 8 references that are in the map. First posted on arXiv 16 Apr 2024.
Builds on
4 of 8 references.
References · 4
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2024Automated Unit Test Improvement using Large Language Models at Metacited by 75
- 2023SALLM: Security Assessment of Generated Codecited by 39
- 2024TestSpark: IntelliJ IDEA's Ultimate Test Generation Companioncited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2025SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinementcited by 9
- 2025Automating a Complete Software Test Process Using LLMs: An Automotive Case Studycited by 8
- 2024DAWN: Designing Distributed Agents in a Worldwide Networkcited by 6
- 2025MASTEST: A LLM-Based Multi-Agent System For RESTful API Testscited by 0
- 2025MASTEST: A LLM-Based Multi-Agent System For RESTful API Tests22 Nov 2025
- 2025SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement4 Apr 2025
- 2025Automating a Complete Software Test Process Using LLMs: An Automotive Case Study6 Feb 2025
- 2024DAWN: Designing Distributed Agents in a Worldwide Network11 Oct 2024