mlsanityData to 14 Oct 2026

Can large language models generate salient negative statements?

arXiv 2305.16755 ↗First posted 26 May 2023cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We examine the ability of large language models (LLMs) to generate salient (interesting) negative statements about real-world entities; an emerging research topic of the last few years. We probe the LLMs using zero- and k-shot unconstrained probes, and compare with traditional methods for negation generation, i.e., pattern-based textual extractions and knowledge-graph-based inferences, as well as crowdsourced gold statements. We measure the correctness and salience of the generated lists about subjects from different domains. Our evaluation shows that guided probes do in fact improve the quality of generated negatives, compared to the zero-shot variant. Nevertheless, using both prompts, LLMs still struggle with the notion of factuality of negatives, frequently generating many ambiguous statements, or statements with negative keywords but a positive meaning.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

11 of 19 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Language Models as Knowledge Bases?cited by 1,936
  3. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 243
  4. 2022Can Large Language Models Truly Understand Prompts? A Case Study with Negated Promptscited by 59
  5. 2020Language Models as Fact Checkers?cited by 51
  6. 2023Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledgecited by 32
  7. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  8. 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
  9. 2020NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Basescited by 9
  10. 2022UnCommonSense: Informative Negative Knowledge about Everyday Conceptscited by 8
  11. 2023Completeness, Recall, and Negation in Open-World Knowledge Bases: A Surveycited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 0; 2025: 0; 2026: 1.

3 papers.