mlsanityData to 14 Oct 2026

Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistance

arXiv 2405.17076 ↗First posted 27 May 2024cs.AI cs.CL cs.IRcited by 13

Not on the map. Why?

Abstract (arXiv)

In this work we will show that language models with less than one billion parameters can be used to translate natural language to SPARQL queries after fine-tuning. Using three different datasets ranging from academic to real world, we identify prerequisites that the training data must fulfill in order for the training to be successful. The goal is to empower users of semantic web technology to use AI assistance with affordable commodity hardware, making them more resilient against external factors.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 27 May 2024.

Builds on

16 of 26 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  7. 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
  8. 2023LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPTcited by 42
  9. 2022QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakerscited by 39
  10. 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
  11. 2024SPARQL Generation: an analysis on fine-tuning OpenLLaMA for Question Answering over a Life Science Knowledge Graphcited by 19
  12. 2023Developing a Scalable Benchmark for Assessing Large Language Models in Knowledge Graph Engineeringcited by 13
4 more
  1. 2023Benchmarking the Abilities of Large Language Models for RDF Knowledge Graph Creation and Comprehension: How Well Do LLMs Speak Turtle?cited by 11
  2. 2023A Comprehensive Evaluation of Neural SPARQL Query Generation from Natural Language Questionscited by 9
  3. 2023REDrm FM: a Filtered and Multilingual Relation Extraction Datasetcited by 6
  4. 2024SPARQL Generation with Entity Pre-trained GPT for KG Question Answeringcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 9.

13 papers.

Sort:

By area:

  1. 2024InkubaLM: A small language model for low-resource African languagescited by 18
  2. 2024Assessing SPARQL capabilities of Large Language Modelscited by 14
  3. 2025GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databasescited by 7
  4. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Datacited by 6
  5. 2025Enhancing Text2Cypher with Schema Filteringcited by 6
  6. 2025SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injectioncited by 6
  7. 2025Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrievalcited by 3
  8. 2025LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMscited by 3
  9. 2025Conversational Lexicography: Querying Lexicographic Data on Knowledge Graphs with SPARQL through Natural Languagecited by 3
  10. 2025ARUQULA -- An LLM based Text2SPARQL Approach using ReAct and Knowledge Graph Exploration Utilitiescited by 3
  11. 2025QUPID: Quantified Understanding for Enhanced Performance, Insights, and Decisions in Korean Search Enginescited by 1
  12. 2025The benefits of query-based KGQA systems for complex and temporal questions in LLM eracited by 1
1 more
  1. 2024Personal Intelligence System UniLM: Hybrid On-Device Small Language Model and Server-Based Large Language Model for Malay Nusantaracited by 0