mlsanityData to 7 Oct 2026

Generated Knowledge Prompting for Commonsense Reasoning

arXiv 2110.08387 ↗First posted 15 Oct 2021cs.CLcited by 213

Not on the map. Why?

Cited by 40 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting, which consists of generating knowledge from a language model, then providing the knowledge as additional input when answering a question. Our method does not require task-specific supervision for knowledge integration, or access to a structured knowledge base, yet it improves performance of large-scale, state-of-the-art models on four commonsense reasoning tasks, achieving state-of-the-art results on numerical commonsense (NumerSense), general commonsense (CommonsenseQA 2.0), and scientific commonsense (QASC) benchmarks. Generated knowledge prompting highlights large-scale language models as flexible sources of external knowledge for improving commonsense reasoning. Our code is available at https://github.com/liujch1998/GKP

Key facts. Cited by 213 papers in the map (data through 7 Oct 2026). Builds on 30 of its 47 references that are in the map. First posted on arXiv 15 Oct 2021.

Builds on

30 of 47 references.

References · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  4. 2019Language Models as Knowledge Bases?cited by 1,922
  5. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  6. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  7. 2019How Can We Know What Language Models Know?cited by 953
  8. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  9. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  10. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  11. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  12. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
18 more
  1. 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
  2. 2019Abductive Commonsense Reasoningcited by 300
  3. 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
  4. 2018A Simple Method for Commonsense Reasoningcited by 223
  5. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  6. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  7. 2020Unsupervised Commonsense Question Answering with Self-Talkcited by 161
  8. 2020Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Modelscited by 110
  9. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  10. 2019Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answeringcited by 68
  11. 2018Improving Question Answering by Commonsense-Based Pre-Trainingcited by 66
  12. 2019Zero-shot Text Classification With Generative Language Modelscited by 55
  13. 2021Prompting Contrastive Explanations for Commonsense Reasoning Taskscited by 45
  14. 2019Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answeringcited by 37
  15. 2020Explaining Question Answering Models through Text Generationcited by 33
  16. 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
  17. 2019How Additional Knowledge can Improve Natural Language Commonsense Question Answering?cited by 22
  18. 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformationcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 27; 2023: 76; 2024: 65; 2025: 30; 2026: 12.

213 papers.

Sort:

By area:

  1. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  2. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  4. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  5. 2022Generating Sequences by Learning to Self-Correctcited by 271
  6. 2022What does a platypus look like? Generating customized prompts for zero-shot image classificationcited by 263
  7. 2022Reasoning with Language Model Prompting: A Surveycited by 251
  8. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
  9. 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
  10. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  11. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  12. 2022Rationale-Augmented Ensembles in Language Modelscited by 111
38 more
  1. 2022PromptCap: Prompt-Guided Task-Aware Image Captioningcited by 104
  2. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 97
  3. 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 94
  4. 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
  5. 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planningcited by 81
  6. 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
  7. 2023Unleashing the potential of prompt engineering for large language modelscited by 72
  8. 2022Recitation-Augmented Language Modelscited by 65
  9. 2023ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Modelscited by 63
  10. 2023Natural Language Reasoning, A Surveycited by 61
  11. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Modelcited by 60
  12. 2023Don't throw away your value model! Generating more preferable text with Value-Guided Monte-Carlo Tree Search decodingcited by 59
  13. 2022PINTO: Faithful Language Reasoning Using Prompt-Generated Rationalescited by 56
  14. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  15. 2023Resolving Knowledge Conflicts in Large Language Modelscited by 49
  16. 2024Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?cited by 47
  17. 2024Interleaved-Modal Chain-of-Thoughtcited by 47
  18. 2023Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Modelscited by 46
  19. 2024A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Taskscited by 46
  20. 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statementscited by 44
  21. 2024HiGPT: Heterogeneous Graph Language Modelcited by 44
  22. 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
  23. 2022Sub-Task Decomposition Enables Learning in Sequence to Sequence Taskscited by 41
  24. 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agentscited by 41
  25. 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attentioncited by 40
  26. 2023Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objectscited by 40
  27. 2022Self-Prompting Large Language Models for Zero-Shot Open-Domain QAcited by 39
  28. 2023Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RLcited by 37
  29. 2023Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Modelscited by 37
  30. 2023Merging Generated and Retrieved Knowledge for Open-Domain QAcited by 36
  31. 2024Knowledge Boundary of Large Language Models: A Surveycited by 36
  32. 2023How are Prompts Different in Terms of Sensitivity?cited by 34
  33. 2023Joint Prompt Optimization of Stacked LLMs using Variational Inferencecited by 32
  34. 2024Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphscited by 32
  35. 2024Establishing Task Scaling Laws via Compute-Efficient Model Ladderscited by 32
  36. 2024Integrating Large Language Models in Causal Discovery: A Statistical Causal Approachcited by 31
  37. 2024LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Predictioncited by 31
  38. 2024Exploring Autonomous Agents through the Lens of Large Language Models: A Reviewcited by 30

50 most cited of 213 All 213 (JSON)