LLM-based SPARQL Query Generation from Natural Language over Federated Knowledge Graphs
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
We introduce a Retrieval-Augmented Generation (RAG) system for translating user questions into accurate federated SPARQL queries over bioinformatics knowledge graphs (KGs) leveraging Large Language Models (LLMs). To enhance accuracy and reduce hallucinations in query generation, our system utilises metadata from the KGs, including query examples and schema information, and incorporates a validation step to correct generated queries. The system is available online at chat.expasy.org.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 5 of its 12 references that are in the map. First posted on arXiv 8 Oct 2024.
Builds on
5 of 12 references.
References · 5
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2023DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge Graphcited by 18
- 2024Assessing SPARQL capabilities of Large Language Modelscited by 14
- 2023On the Potential of Artificial Intelligence Chatbots for Data Exploration of Federated Bioinformatics Knowledge Graphscited by 9
- 2024Generalist embedding models are better at short-context clinical semantic search than specialized embedding modelscited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 10; 2026: 11.
22 papers.
Sort:
By area:
- 2024CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Eracited by 16
- 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbotscited by 10
- 2025Enhancing Text2Cypher with Schema Filteringcited by 6
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injectioncited by 6
- 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrievalcited by 3
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questionscited by 3
- 2026Agentic SPARQL: Evaluating SPARQL-MCP-powered Intelligent Agents on the Federated KGQA Benchmarkcited by 3
- 2025FRASE: Structured Representations for Generalizable SPARQL Query Generationcited by 2
- 2025Enhancing Frame Detection with Retrieval Augmented Generationcited by 1
- 2026Query Symbolically or Retrieve Semantically? A Dataset and Method for Semi-Structured Question Answeringcited by 1
- 2025Q2Forge: Minting Competency Questions and SPARQL Queries for Question-Answering Over Knowledge Graphscited by 0
- 2025Knowledge Conceptualization Impacts RAG Efficacycited by 0
10 more
- 2025MetaboT: An LLM-based Multi-Agent Frameworkfor Interactive Analysis of Mass SpectrometryMetabolomics Knowledge Graphscited by 0
- 2026Publishing FAIR and Machine-actionable Reviews in Materials Science: The Case for Symbolic Knowledge in Neuro-symbolic Artificial Intelligencecited by 0
- 2026The Initial Exploration Problem in Knowledge Graph Explorationcited by 0
- 2026Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytellingcited by 0
- 2026DeSQ: Decomposition-based SPARQL Query Generationcited by 0
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQAcited by 0
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphscited by 0
- 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigationcited by 0
- 2026Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)cited by 0
- 2026Natural Language Knowledge Graph Query Execution: Leveraging Controlled Semantics in the LLM Context Windowcited by 0
- 2026Natural Language Knowledge Graph Query Execution: Leveraging Controlled Semantics in the LLM Context Window13 Sep 2026
- 2026Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)10 Sep 2026
- 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation1 Sep 2026
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphs14 Aug 2026
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA16 Jul 2026
- 2026DeSQ: Decomposition-based SPARQL Query Generation29 May 2026
- 2026Query Symbolically or Retrieve Semantically? A Dataset and Method for Semi-Structured Question Answering26 May 2026
- 2026Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytelling2 Apr 2026
- 2026The Initial Exploration Problem in Knowledge Graph Exploration24 Feb 2026
- 2026Agentic SPARQL: Evaluating SPARQL-MCP-powered Intelligent Agents on the Federated KGQA Benchmark20 Jan 2026
- 2026Publishing FAIR and Machine-actionable Reviews in Materials Science: The Case for Symbolic Knowledge in Neuro-symbolic Artificial Intelligence8 Jan 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
10 more
- 2025MetaboT: An LLM-based Multi-Agent Frameworkfor Interactive Analysis of Mass SpectrometryMetabolomics Knowledge Graphs2 Oct 2025
- 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbots5 Aug 2025
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection18 Jul 2025
- 2025Knowledge Conceptualization Impacts RAG Efficacy12 Jul 2025
- 2025Q2Forge: Minting Competency Questions and SPARQL Queries for Question-Answering Over Knowledge Graphs19 May 2025
- 2025Enhancing Text2Cypher with Schema Filtering8 May 2025
- 2025FRASE: Structured Representations for Generalizable SPARQL Query Generation28 Mar 2025
- 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrieval19 Feb 2025
- 2025Enhancing Frame Detection with Retrieval Augmented Generation17 Feb 2025
- 2024CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Era24 Dec 2024
- 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbotscited by 10
- 2026Agentic SPARQL: Evaluating SPARQL-MCP-powered Intelligent Agents on the Federated KGQA Benchmarkcited by 3
- 2025MetaboT: An LLM-based Multi-Agent Frameworkfor Interactive Analysis of Mass SpectrometryMetabolomics Knowledge Graphscited by 0
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphscited by 0
- 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigationcited by 0
- 2026KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation1 Sep 2026
- 2026AutoSchema: Live Schema Grounding for Agentic Text-to-Sparql over Heterogeneous Knowledge Graphs14 Aug 2026
- 2026Agentic SPARQL: Evaluating SPARQL-MCP-powered Intelligent Agents on the Federated KGQA Benchmark20 Jan 2026
- 2025MetaboT: An LLM-based Multi-Agent Frameworkfor Interactive Analysis of Mass SpectrometryMetabolomics Knowledge Graphs2 Oct 2025
- 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbots5 Aug 2025
- 2024CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Eracited by 16
- 2025Enhancing Text2Cypher with Schema Filteringcited by 6
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injectioncited by 6
- 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrievalcited by 3
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questionscited by 3
- 2025FRASE: Structured Representations for Generalizable SPARQL Query Generationcited by 2
- 2025Q2Forge: Minting Competency Questions and SPARQL Queries for Question-Answering Over Knowledge Graphscited by 0
- 2025Knowledge Conceptualization Impacts RAG Efficacycited by 0
- 2026Publishing FAIR and Machine-actionable Reviews in Materials Science: The Case for Symbolic Knowledge in Neuro-symbolic Artificial Intelligencecited by 0
- 2026The Initial Exploration Problem in Knowledge Graph Explorationcited by 0
- 2026Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytellingcited by 0
- 2026DeSQ: Decomposition-based SPARQL Query Generationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Natural Language Knowledge Graph Query Execution: Leveraging Controlled Semantics in the LLM Context Window13 Sep 2026
- 2026Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)10 Sep 2026
- 2026DeSQ: Decomposition-based SPARQL Query Generation29 May 2026
- 2026Competency Questions as Executable Plans: a Controlled RAG Architecture for Cultural Heritage Storytelling2 Apr 2026
- 2026The Initial Exploration Problem in Knowledge Graph Exploration24 Feb 2026
- 2026Publishing FAIR and Machine-actionable Reviews in Materials Science: The Case for Symbolic Knowledge in Neuro-symbolic Artificial Intelligence8 Jan 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection18 Jul 2025
- 2025Knowledge Conceptualization Impacts RAG Efficacy12 Jul 2025
- 2025Q2Forge: Minting Competency Questions and SPARQL Queries for Question-Answering Over Knowledge Graphs19 May 2025
- 2025Enhancing Text2Cypher with Schema Filtering8 May 2025
- 2025FRASE: Structured Representations for Generalizable SPARQL Query Generation28 Mar 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphs
- 2025Augmented Knowledge Graph Querying leveraging LLMs
- 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systems
- 2024T-RAG: Lessons from the LLM Trenches
- 2025Personalizing Large Language Models using Retrieval Augmented Generation and Knowledge Graph
- 2024Meta Knowledge for Retrieval Augmented Large Language Models
- 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Bases
- 2024RAGONITE: Iterative Retrieval on Induced Databases and Verbalized RDF for Conversational QA over KGs with RAG