QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers
Not on the map. Why?
Abstract (arXiv)
The ability to have the same experience for different user groups (i.e., accessibility) is one of the most important characteristics of Web-based systems. The same is true for Knowledge Graph Question Answering (KGQA) systems that provide the access to Semantic Web data via natural language interface. While following our research agenda on the multilingual aspect of accessibility of KGQA systems, we identified several ongoing challenges. One of them is the lack of multilingual KGQA benchmarks. In this work, we extend one of the most popular KGQA benchmarks - QALD-9 by introducing high-quality questions' translations to 8 languages provided by native speakers, and transferring the SPARQL queries of QALD-9 from DBpedia to Wikidata, s.t., the usability and relevance of the dataset is strongly increased. Five of the languages - Armenian, Ukrainian, Lithuanian, Bashkir and Belarusian - to our best knowledge were never considered in KGQA research community before. The latter two of the languages are considered as "endangered" by UNESCO. We call the extended dataset QALD-9-plus and made it available online https://github.com/Perevalov/qald_9_plus.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 3 of its 19 references that are in the map. First posted on arXiv 31 Jan 2022.
Builds on
3 of 19 references.
References · 3
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 12; 2025: 15; 2026: 6.
39 papers.
Sort:
By area:
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
- 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaborationcited by 16
- 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
- 2024Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistancecited by 13
- 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 11
- 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languagescited by 10
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphscited by 9
27 more
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answeringcited by 8
- 2024ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphscited by 8
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translationcited by 8
- 2022Do I have the Knowledge to Answer? Investigating Answerability of Knowledge Base Questionscited by 7
- 2024Towards Automatic Composition of ASP Programs from Natural Language Specificationscited by 7
- 2025Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enrichingcited by 7
- 2024MST5 -- Multilingual Question Answering over Knowledge Graphscited by 5
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injectioncited by 5
- 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphscited by 5
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
- 2024MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detectioncited by 4
- 2025Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoningcited by 4
- 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Basescited by 3
- 2023GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language Modelscited by 2
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questionscited by 2
- 2024Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Constructioncited by 1
- 2025Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphscited by 1
- 2025Automating SPARQL Query Translations between DBpedia and Wikidatacited by 1
- 2025From Graph Retrieval to Schema Realization: Counterfactual Validation for Text-to-SPARQL over Heterogeneous Knowledge Graphscited by 1
- 2026PIPE-RDF: An LLM-Assisted Pipeline for Enterprise RDF Benchmarkingcited by 1
- 2026Text-to-SPARQL Generation with Reinforcement Learning: A GRPO-based Approach on DBLPcited by 1
- 2022Question-type Identification for Academic Questions in Online Learning Platformcited by 0
- 2025Explainable Benchmarking through the Lense of Concept Learningcited by 0
- 2026SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generationcited by 0
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQAcited by 0
- 2026Towards Researcher Agents for Knowledge-Graph Question Answeringcited by 0
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Modelscited by 0
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models24 Aug 2026
- 2026Towards Researcher Agents for Knowledge-Graph Question Answering7 Aug 2026
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA16 Jul 2026
- 2026SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generation16 Jul 2026
- 2026Text-to-SPARQL Generation with Reinforcement Learning: A GRPO-based Approach on DBLP19 May 2026
- 2026PIPE-RDF: An LLM-Assisted Pipeline for Enterprise RDF Benchmarking15 Feb 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
- 2025Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoning11 Nov 2025
- 2025Explainable Benchmarking through the Lense of Concept Learning23 Oct 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching25 Sep 2025
- 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphs14 Aug 2025
27 more
- 2025From Graph Retrieval to Schema Realization: Counterfactual Validation for Text-to-SPARQL over Heterogeneous Knowledge Graphs3 Aug 2025
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection18 Jul 2025
- 2025Automating SPARQL Query Translations between DBpedia and Wikidata14 Jul 2025
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs12 Jun 2025
- 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking29 May 2025
- 2025Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphs21 May 2025
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey8 Apr 2025
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation9 Mar 2025
- 2025Neuro-Symbolic AI in 2024: A Systematic Review9 Jan 2025
- 2024Graph Retrieval-Augmented Generation: A Survey15 Aug 2024
- 2024Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction5 Aug 2024
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions16 Jul 2024
- 2024MST5 -- Multilingual Question Answering over Knowledge Graphs8 Jul 2024
- 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs3 Jun 2024
- 2024MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection29 May 2024
- 2024Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistance27 May 2024
- 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applications23 Apr 2024
- 2024ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphs11 Apr 2024
- 2024Towards Automatic Composition of ASP Programs from Natural Language Specifications7 Mar 2024
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answering15 Feb 2024
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration7 Feb 2024
- 2023GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language Models12 Oct 2023
- 2023Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases15 Sep 2023
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph15 Jul 2023
- 2022Do I have the Knowledge to Answer? Investigating Answerability of Knowledge Base Questions20 Dec 2022
- 2022Question-type Identification for Academic Questions in Online Learning Platform24 Nov 2022
- 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages12 May 2022
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaborationcited by 16
- 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 11
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphscited by 9
- 2025Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enrichingcited by 7
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
- 2025Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoningcited by 4
- 2026Text-to-SPARQL Generation with Reinforcement Learning: A GRPO-based Approach on DBLPcited by 1
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQAcited by 0
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Modelscited by 0
- 2026Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models24 Aug 2026
- 2026MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA16 Jul 2026
- 2026Text-to-SPARQL Generation with Reinforcement Learning: A GRPO-based Approach on DBLP19 May 2026
- 2025Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoning11 Nov 2025
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs9 Oct 2025
- 2025Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching25 Sep 2025
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs12 Jun 2025
- 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking29 May 2025
- 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration7 Feb 2024
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph15 Jul 2023
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
- 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
- 2024EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphscited by 14
- 2024Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistancecited by 13
- 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languagescited by 10
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answeringcited by 8
- 2022Do I have the Knowledge to Answer? Investigating Answerability of Knowledge Base Questionscited by 7
- 2024Towards Automatic Composition of ASP Programs from Natural Language Specificationscited by 7
- 2024MST5 -- Multilingual Question Answering over Knowledge Graphscited by 5
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injectioncited by 5
- 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphscited by 5
12 most cited of 24 All 24 (JSON)
- 2026Towards Researcher Agents for Knowledge-Graph Question Answering7 Aug 2026
- 2026PIPE-RDF: An LLM-Assisted Pipeline for Enterprise RDF Benchmarking15 Feb 2026
- 2025SPARQL-LLM: Real-Time SPARQL Query Generation from Natural Language Questions16 Dec 2025
- 2025Explainable Benchmarking through the Lense of Concept Learning23 Oct 2025
- 2025FIRESPARQL: A LLM-based Framework for SPARQL Query Generation over Scholarly Knowledge Graphs14 Aug 2025
- 2025From Graph Retrieval to Schema Realization: Counterfactual Validation for Text-to-SPARQL over Heterogeneous Knowledge Graphs3 Aug 2025
- 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection18 Jul 2025
- 2025Automating SPARQL Query Translations between DBpedia and Wikidata14 Jul 2025
- 2025Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphs21 May 2025
- 2025Neuro-Symbolic AI in 2024: A Systematic Review9 Jan 2025
- 2024Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction5 Aug 2024
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questions16 Jul 2024
12 newest of 24 All 24 (JSON)