Fusing Context Into Knowledge Graph for Commonsense Question Answering
Not on the map. Why?
Abstract (arXiv)
Commonsense question answering (QA) requires a model to grasp commonsense and factual knowledge to answer questions about world events. Many prior methods couple language modeling with knowledge graphs (KG). However, although a KG contains rich structural information, it lacks the context to provide a more precise understanding of the concepts. This creates a gap when fusing knowledge graphs into language modeling, especially when there is insufficient labeled data. Thus, we propose to employ external entity descriptions to provide contextual information for knowledge understanding. We retrieve descriptions of related concepts from Wiktionary and feed them as additional input to pre-trained language models. The resulting model achieves state-of-the-art result in the CommonsenseQA dataset and the best result among non-generative models in OpenBookQA.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 10; 2024: 4; 2025: 2.
33 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attentioncited by 40
- 2022Infusing Knowledge from Wikipedia to Enhance Stance Detectioncited by 20
- 2023Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inferencecited by 13
- 2022DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learningcited by 11
- 2022Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfercited by 10
- 2021Leveraging Knowledge in Multilingual Commonsense Reasoningcited by 9
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
21 more
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehensioncited by 8
- 2022Improving Commonsense in Vision-Language Models via Knowledge Graph Riddlescited by 7
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Modelcited by 7
- 2022MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representationcited by 6
- 2023Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answeringcited by 6
- 2022ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answeringcited by 5
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verificationcited by 4
- 2023KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanationscited by 4
- 2022Detecting Euphemisms with Literal Descriptions and Visual Imagerycited by 3
- 2023Decouple knowledge from parameters for plug-and-play language modelingcited by 3
- 2021Commonsense Knowledge in Word Associations and ConceptNetcited by 2
- 2023KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answeringcited by 2
- 2021Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Factscited by 1
- 2022Ered: Enhanced Text Representations with Entities and Descriptionscited by 1
- 2022Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabularycited by 1
- 2024EEE-QA: Exploring Effective and Efficient Question-Answer Representationscited by 1
- 2022Solution of DeBERTaV3 on CommonsenseQAcited by 0
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluationcited by 0
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answeringcited by 0
- 2024Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoningcited by 0
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answeringcited by 0
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Model26 May 2025
- 2024Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoning27 Sep 2024
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answering21 Aug 2024
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation10 Jul 2024
- 2024EEE-QA: Exploring Effective and Efficient Question-Answer Representations4 Mar 2024
- 2023Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference19 Jun 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanations5 Jun 2023
- 2023Decouple knowledge from parameters for plug-and-play language modeling19 May 2023
- 2023KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answering15 May 2023
- 2023Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering14 May 2023
21 more
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification10 May 2023
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender System25 Mar 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks30 Jan 2023
- 2022Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles29 Nov 2022
- 2022ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering14 Nov 2022
- 2022Detecting Euphemisms with Literal Descriptions and Visual Imagery8 Nov 2022
- 2022MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation14 Oct 2022
- 2022Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary12 Oct 2022
- 2022Ered: Enhanced Text Representations with Entities and Descriptions18 Aug 2022
- 2022DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning1 Aug 2022
- 2022Solution of DeBERTaV3 on CommonsenseQA30 Apr 2022
- 2022Infusing Knowledge from Wikipedia to Enhance Stance Detection8 Apr 2022
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension16 Mar 2022
- 2022Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer14 Mar 2022
- 2021Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Facts17 Dec 2021
- 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention6 Dec 2021
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering6 Dec 2021
- 2021Leveraging Knowledge in Multilingual Commonsense Reasoning16 Oct 2021
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering8 Oct 2021
- 2021Commonsense Knowledge in Word Associations and ConceptNet20 Sep 2021
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehensioncited by 8
- 2022MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representationcited by 6
- 2022Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabularycited by 1
- 2024Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoningcited by 0
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answeringcited by 0
- 2025KGFR: A Foundation Retriever for Generalized Knowledge Graph Question Answering6 Nov 2025
- 2024Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoning27 Sep 2024
- 2022MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation14 Oct 2022
- 2022Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary12 Oct 2022
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension16 Mar 2022
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attentioncited by 40
- 2022Infusing Knowledge from Wikipedia to Enhance Stance Detectioncited by 20
- 2023Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inferencecited by 13
- 2022DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learningcited by 11
- 2022Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfercited by 10
- 2021Leveraging Knowledge in Multilingual Commonsense Reasoningcited by 9
- 2023Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networkscited by 9
12 most cited of 27 All 27 (JSON)
- 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Model26 May 2025
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answering21 Aug 2024
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation10 Jul 2024
- 2024EEE-QA: Exploring Effective and Efficient Question-Answer Representations4 Mar 2024
- 2023Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference19 Jun 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanations5 Jun 2023
- 2023Decouple knowledge from parameters for plug-and-play language modeling19 May 2023
- 2023KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answering15 May 2023
- 2023Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering14 May 2023
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification10 May 2023
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender System25 Mar 2023
12 newest of 27 All 27 (JSON)