mlsanityData to 7 Oct 2026

KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning

arXiv 2009.12677 ↗First posted 26 Sep 2020cs.CL cs.SCcited by 106

Not on the map. Why?

Abstract (arXiv)

Generative commonsense reasoning which aims to empower machines to generate sentences with the capacity of reasoning over a set of concepts is a critical bottleneck for text generation. Even the state-of-the-art pre-trained language generation models struggle at this task and often produce implausible and anomalous sentences. One reason is that they rarely consider incorporating the knowledge graph which can provide rich relational information among the commonsense concepts. To promote the ability of commonsense reasoning for text generation, we propose a novel knowledge graph augmented pre-trained language generation model KG-BART, which encompasses the complex relations of concepts through the knowledge graph and produces more logical and natural sentences as output. Moreover, KG-BART can leverage the graph attention to aggregate the rich concept semantics that enhances the model generalization on unseen concept sets. Experiments on benchmark CommonGen dataset verify the effectiveness of our proposed approach by comparing with several strong pre-trained language generation models, particularly KG-BART outperforms BART by 5.80, 4.60, in terms of BLEU-3, 4. Moreover, we also show that the generated context by our model can work as background scenarios to benefit downstream commonsense QA tasks.

Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 21; 2022: 31; 2023: 29; 2024: 13; 2025: 10; 2026: 2.

106 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  3. 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 167
  4. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  5. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
  6. 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
  7. 2023ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Modelscited by 63
  8. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Pathscited by 60
  9. 2021Federated Social Recommendation with Graph Neural Networkcited by 56
  10. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  11. 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 50
  12. 2022RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Groundingcited by 47
38 more
  1. 2021Differentially Private Federated Knowledge Graphs Embeddingcited by 45
  2. 2021Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networkscited by 38
  3. 2021Dict-BERT: Enhancing Language Model Pre-training with Dictionarycited by 38
  4. 2023Evaluating Large Language Models on Graphs: Performance Insights and Comparative Analysiscited by 35
  5. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  6. 2023Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledgecited by 32
  7. 2021Relational World Knowledge Representation in Contextual Language Models: A Reviewcited by 31
  8. 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
  9. 2022Visualize Before You Write: Imagination-Guided Open-Ended Text Generationcited by 30
  10. 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
  11. 2023HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responsescited by 25
  12. 2022UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQLcited by 20
  13. 2021DSKReG: Differentiable Sampling on Knowledge Graph for Recommendation with Relational GNNcited by 19
  14. 2022Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Expertscited by 19
  15. 2023KILM: Knowledge Injection into Encoder-Decoder Language Modelscited by 19
  16. 2024Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learningcited by 19
  17. 2021Retrieval Enhanced Model for Commonsense Generationcited by 18
  18. 2021NAREOR: The Narrative Reordering Problemcited by 14
  19. 2022Retrieval Augmentation for Commonsense Reasoning: A Unified Approachcited by 14
  20. 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
  21. 2021HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarizationcited by 13
  22. 2023Large Knowledge Model: Perspectives and Challengescited by 12
  23. 2021Structure Inducing Pre-Trainingcited by 10
  24. 2021Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognitioncited by 10
  25. 2022KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph Completioncited by 10
  26. 2022CAB: Comprehensive Attention Benchmarking on Long Sequence Modelingcited by 10
  27. 2023Generations of Knowledge Graphs: The Crazy Ideas and the Business Impactcited by 10
  28. 2024KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptationcited by 10
  29. 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Modelscited by 9
  30. 2022TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledgecited by 9
  31. 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understandingcited by 9
  32. 2022Knowledge Prompting in Pre-trained Language Model for Natural Language Understandingcited by 9
  33. 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generationcited by 8
  34. 2022Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoningcited by 8
  35. 2023Enhancing Biomedical Lay Summarisation with External Knowledge Graphscited by 8
  36. 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
  37. 2021SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoningcited by 7
  38. 2021Open Relation Modeling: Learning to Define Relations between Entitiescited by 7

50 most cited of 106 All 106 (JSON)