mlsanityData to 14 Oct 2026

Leveraging LLMs in Scholarly Knowledge Graph Question Answering

arXiv 2311.09841 ↗First posted 16 Nov 2023cs.CL cs.AI cs.DBcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n similar training questions related to a given test question via a BERT-based sentence encoder and retrieves their corresponding SPARQL. Using the top-n similar question-SPARQL pairs as an example and the test question creates a prompt. Then pass the prompt to the LLM and generate a SPARQL. Finally, runs the SPARQL against the underlying KG - ORKG (Open Research KG) endpoint and returns an answer. Our system achieves an F1 score of 99.0%, on SciQA - one of the Scholarly-QALD-23 challenge benchmarks.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 9 of its 18 references that are in the map. First posted on arXiv 16 Nov 2023.

Builds on

9 of 18 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  5. 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
  6. 2023Evaluating Open-Domain Question Answering in the Era of Large Language Modelscited by 111
  7. 2023DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge Graphcited by 18
  8. 2020Question Answering on Scholarly Knowledge Graphscited by 7
  9. 2023GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answeringcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 6; 2026: 1.

13 papers.

Sort:

By area: