PrediQL: Automated Testing of GraphQL APIs with LLMs
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
GraphQL's flexible query model and nested data dependencies expose APIs to complex, context-dependent vulnerabilities that are difficult to uncover using conventional testing tools. Existing fuzzers either rely on random payload generation or rigid mutation heuristics, failing to adapt to the dynamic structures of GraphQL schemas and responses. We present PrediQL, the first retrieval-augmented, LLM-guided fuzzer for GraphQL APIs. PrediQL combines large language model reasoning with adaptive feedback loops to generate semantically valid and diverse queries. It models the choice of fuzzing strategy as a multi-armed bandit problem, balancing exploration of new query structures with exploitation of past successes. To enhance efficiency, PrediQL retrieves and reuses execution traces, schema fragments, and prior errors, enabling self-correction and progressive learning across test iterations. Beyond input generation, PrediQL integrates a context-aware vulnerability detector that uses LLM reasoning to analyze responses, interpreting data values, error messages, and status codes to identify issues such as injection flaws, access-control bypasses, and information disclosure. Our evaluation across open-source and benchmark GraphQL APIs shows that PrediQL achieves significantly higher coverage and vulnerability discovery rates compared to state-of-the-art baselines. These results demonstrate that combining retrieval-augmented reasoning with adaptive fuzzing can transform API security testing from reactive enumeration to intelligent exploration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 41 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
12 of 41 references.
References · 12
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2022Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Modelscited by 103
- 2023Fuzz4All: Universal Fuzzing with Large Language Modelscited by 88
- 2025ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Spacecited by 15
- 2024Large Language Model assisted Hybrid Fuzzingcited by 4
- 2021Deriving Semantics-Aware Fuzzers from Web API Schemascited by 3
- 2025GraphQLer: Enhancing GraphQL Security with Context-Aware API Testingcited by 2
- 2025Enhancing GraphQL Security by Detecting Malicious Queries Using Large Language Models, Sentence Transformers, and Convolutional Neural Networkscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Rethinking Agentic Workflows: Evaluating Inference-Based Test-Time Scaling Strategies in Text2SQL Tasks
- 2026Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World Systems
- 2026ARQ: Agentic CodeQL Query Refinement for C/C++ Vulnerability Detection
- 2026Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing
- 2024DistillSeq: A Framework for Safety Alignment Testing in Large Language Models using Knowledge Distillation
- 2026LLMs taking shortcuts in test generation: A study with SAP HANA and LevelDB
- 2026SmartOracle -- An Agentic Approach to Mitigate Noise in Differential Oracles
- 2026REST API Testing with Verified LLM-Inferred Dependencies and Response-Driven Refinement ↗