mlsanityData to 14 Oct 2026

Automatic Question-Answer Generation for Long-Tail Knowledge

arXiv 2403.01382 ↗First posted 3 Mar 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties in learning about uncommon long-tail knowledge (tail entities). Since manually constructing QA datasets demands substantial human resources, the types of existing QA datasets are limited, leaving us with a scarcity of datasets to study the performance of LLMs on tail entities. In this paper, we propose an automatic approach to generate specialized QA datasets for tail entities and present the associated research challenges. We conduct extensive experiments by employing pretrained LLMs on our newly generated long-tail QA datasets, comparing their performance with and without external resources including Wikipedia and Wikidata knowledge graphs.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 3 Mar 2024.

Builds on

14 of 25 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  8. 2019Language Models as Knowledge Bases?cited by 1,936
  9. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
  10. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 225
  11. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 171
  12. 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
2 more
  1. 2021Memorisation versus Generalisation in Pre-trained Language Modelscited by 32
  2. 2017SLING: A framework for frame semantic parsingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 1.

8 papers.

  1. 2024Are Large Language Models a Good Replacement of Taxonomies?cited by 19
  2. 2024ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertaintycited by 10
  3. 2025LPFQA: A Long-Tail Professional Forum-based Benchmark for LLM Evaluationcited by 4
  4. 2024Augmenting Textual Generation via Topology Aware Retrievalcited by 2
  5. 2025Fact or Guesswork? Evaluating Large Language Models' Medical Knowledge with Structured One-Hop Judgmentscited by 2
  6. 2025A Multi-Stage Framework with Taxonomy-Guided Reasoning for Occupation Classification Using Large Language Modelscited by 2
  7. 2024Are LLMs Really Not Knowledgeable? Mining the Submerged Knowledge in LLMs' Memorycited by 1
  8. 2026TailNLG: A Multilingual Benchmark Addressing Verbalization of Long-Tail Entitiescited by 0